[ 593.862900] env[70535]: INFO neutron.common.config [-] Logging enabled! [ 593.863281] env[70535]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev44 [ 593.863376] env[70535]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70535) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 593.863675] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 593.863776] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 593.864602] env[70535]: WARNING oslo_policy.policy [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 593.864822] env[70535]: WARNING oslo_policy.policy [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 593.866362] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] VMware NSXv3 Agent initialized successfully. [ 593.866760] env[70535]: DEBUG oslo_concurrency.lockutils [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] Acquiring lock "singleton_lock" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.866901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] Acquired lock "singleton_lock" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.867125] env[70535]: DEBUG oslo_concurrency.lockutils [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] Releasing lock "singleton_lock" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.867510] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] Full set of CONF: {{(pid=70535) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 593.867637] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ******************************************************************************** {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 593.867771] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] Configuration options gathered from: {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 593.868038] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 593.868218] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 593.868334] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ================================================================================ {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 593.868559] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] agent_down_time = 75 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.868656] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] allow_automatic_dhcp_failover = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.868801] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] allow_bulk = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.868951] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] api_extensions_path = {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.869128] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] api_paste_config = api-paste.ini {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.869300] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] auth_strategy = keystone {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.869418] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] backdoor_port = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.869528] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] backdoor_socket = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.869673] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] backlog = 4096 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.869819] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] base_mac = fa:16:3e:00:00:00 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.869984] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] bind_host = 0.0.0.0 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.870146] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] bind_port = 9696 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.870290] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] client_socket_timeout = 900 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.870446] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] config_dir = [] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.870583] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.870736] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] config_source = [] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.870884] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] control_exchange = neutron {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.871041] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] core_plugin = ml2 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.871193] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] debug = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.871345] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] default_availability_zones = [] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.871560] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.871707] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] dhcp_agent_notification = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.871884] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] dhcp_agents_per_network = 1 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.872045] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] dhcp_lease_duration = 86400 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.872201] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] dhcp_load_type = networks {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.872449] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] dns_domain = openstacklocal {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.872489] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.872620] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] enable_default_route_bfd = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.872759] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] enable_default_route_ecmp = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.872897] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] enable_dvr = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.873045] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] enable_new_agents = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.873224] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.873379] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] enable_signals = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.873521] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] enable_traditional_dhcp = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.873659] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] external_dns_driver = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.873793] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] filter_validation = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.873939] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] global_physnet_mtu = 8950 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.874086] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] graceful_shutdown_timeout = 60 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.874267] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] host = cpu-1 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.874412] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] host_dvr_for_dhcp = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.874585] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] http_retries = 3 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.874755] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] instance_format = [instance: %(uuid)s] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.874905] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.875068] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ipam_driver = internal {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.875212] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ipv6_pd_enabled = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.875351] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] l3_ha = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.875500] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.875644] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] l3_ha_network_physical_name = {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.875787] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] l3_ha_network_type = {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.876012] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] log_color = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.876174] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] log_config_append = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.876333] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.876476] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] log_dir = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.876616] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] log_file = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.876728] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] log_options = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.876869] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] log_rotate_interval = 1 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.877027] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] log_rotate_interval_type = days {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.877176] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] log_rotation_type = none {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.877289] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.877405] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.877580] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.877729] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.877842] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.877982] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] max_dns_nameservers = 5 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.878134] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] max_header_line = 16384 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.878273] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] max_l3_agents_per_router = 3 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.878412] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] max_logfile_count = 30 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.878549] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] max_logfile_size_mb = 200 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.878686] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] max_subnet_host_routes = 20 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.878859] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] my_ip = 10.180.1.21 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.879027] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] my_ipv6 = ::1 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.879173] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] network_auto_schedule = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.879308] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] network_link_prefix = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.879454] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.879599] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] notify_nova_on_port_data_changes = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.879741] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] notify_nova_on_port_status_changes = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.879884] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] pagination_max_limit = -1 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.880032] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] publish_errors = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.880205] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] rate_limit_burst = 0 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.880362] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] rate_limit_except_level = CRITICAL {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.880504] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] rate_limit_interval = 0 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884022] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] retry_until_window = 30 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884022] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] router_distributed = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884022] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] rpc_resources_processing_step = 20 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884022] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] rpc_response_max_timeout = 600 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884022] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] rpc_response_timeout = 60 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884022] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] send_events_interval = 2 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884022] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] service_plugins = ['router'] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884451] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] setproctitle = on {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884451] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] shell_completion = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884451] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] state_path = /opt/stack/data/neutron {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884451] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] syslog_log_facility = LOG_USER {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884451] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] tcp_keepidle = 600 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884451] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] transport_url = **** {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884451] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] use_journal = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884627] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] use_json = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884627] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] use_ssl = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884627] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] use_stderr = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884627] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] use_syslog = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884627] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] vlan_qinq = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884627] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] vlan_transparent = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884627] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] watch_log_file = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884817] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] wsgi_default_pool_size = 100 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884817] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] wsgi_keep_alive = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884817] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884817] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] wsgi_server_debug = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 593.884817] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_concurrency.disable_process_locking = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.884817] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.884976] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.884976] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.884976] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.884976] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.885092] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.885267] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] profiler.connection_string = messaging:// {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.885413] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] profiler.enabled = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.885501] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] profiler.es_doc_type = notification {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.885657] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] profiler.es_scroll_size = 10000 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.885802] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] profiler.es_scroll_time = 2m {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.885938] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] profiler.filter_error_trace = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.886091] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] profiler.hmac_keys = **** {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.886236] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] profiler.sentinel_service_name = mymaster {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.886387] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] profiler.socket_timeout = 0.1 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.886544] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] profiler.trace_requests = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.886659] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] profiler.trace_sqlalchemy = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.886843] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] profiler_jaeger.process_tags = {} {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.886996] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] profiler_jaeger.service_name_prefix = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.887661] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] profiler_otlp.service_name_prefix = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.887661] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_policy.enforce_new_defaults = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.887661] env[70535]: WARNING oslo_config.cfg [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 593.889047] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_policy.enforce_scope = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889047] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_policy.policy_default_rule = default {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889047] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889047] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889047] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889047] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889299] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889299] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889299] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889299] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_policy.remote_timeout = 60.0 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889299] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889299] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] agent.extensions = [] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889932] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889932] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] service_providers.service_provider = [] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889932] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] QUOTAS.default_quota = -1 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.889932] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.890112] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] QUOTAS.quota_floatingip = 50 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.890182] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] QUOTAS.quota_network = 100 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.890322] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] QUOTAS.quota_port = 500 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.890461] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.890598] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] QUOTAS.quota_router = 10 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.890740] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] QUOTAS.quota_security_group = 10 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.890884] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.891032] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] QUOTAS.quota_subnet = 100 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.891184] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] QUOTAS.track_quota_usage = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.891354] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.891498] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep.group = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.891637] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep.helper_command = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.891782] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.891923] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep.thread_pool_size = 8 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.892109] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep.user = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.892276] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.892415] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_dhcp_release.group = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.892552] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_dhcp_release.helper_command = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.892694] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.892833] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.892971] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_dhcp_release.user = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.893128] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.893266] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_ovs_vsctl.group = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.893430] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_ovs_vsctl.helper_command = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.893590] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.893730] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.893898] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_ovs_vsctl.user = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.894064] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_namespace.capabilities = [21] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.894205] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_namespace.group = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.894343] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_namespace.helper_command = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.894489] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.894633] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_namespace.thread_pool_size = 8 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.894769] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_namespace.user = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.894913] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_conntrack.capabilities = [12] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.895060] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_conntrack.group = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.895202] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_conntrack.helper_command = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.895391] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.895489] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.895629] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_conntrack.user = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.895774] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_link.capabilities = [12, 21] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.895909] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_link.group = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.896060] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_link.helper_command = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.896208] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.896351] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_link.thread_pool_size = 8 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.896490] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] privsep_link.user = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.896650] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.896802] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.896948] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.continue_on_failed_promotions = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.897098] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.dscp = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.897243] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.dscp_inherit = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.897389] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.force_mp_to_policy = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.897529] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.locking_coordinator_url = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.897669] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.log_agent_heartbeats = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.897808] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.logging_expire = 1 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.897951] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.898104] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.898254] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.polling_interval = 240 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.898399] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.898545] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.898693] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.report_interval = 30.0 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.898840] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.898985] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.899144] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.899287] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.sync_skew = 60 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.899430] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.synchronization_queue_size = 20 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.899575] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT.use_helper_for_ns_read = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.899722] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] SECURITYGROUP.enable_ipset = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.899870] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] SECURITYGROUP.enable_security_group = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.900026] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.900178] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.900326] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] experimental.ipv6_pd_enabled = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.900491] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ml2.extension_drivers = ['port_security'] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.900634] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ml2.external_network_type = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.900787] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.900934] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ml2.overlay_ip_version = 4 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.901091] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ml2.path_mtu = 8950 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.901241] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ml2.physical_network_mtus = {} {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.901401] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ml2.tenant_network_types = ['vlan'] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.901550] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.901699] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ml2.type_drivers = ['vlan'] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.901849] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT_CLI.neutron_port_id = [] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.901990] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.902142] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.902296] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.902446] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.902593] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.902742] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.902891] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.903047] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.903254] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.903409] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_login_password = **** {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.903564] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_login_port = 443 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.903711] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_login_user = admin {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.903857] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.904015] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.904164] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.904308] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.904457] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.904608] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.904754] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.904899] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.905053] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.905203] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.905354] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.905516] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.905642] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.905837] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.905999] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] vsphere.vsphere_login_password = VMware1! {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.906160] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.906303] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.906451] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] nova.auth_section = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.906601] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] nova.auth_type = password {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.906747] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.906887] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] nova.certfile = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.907039] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] nova.collect_timing = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.907189] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] nova.endpoint_type = public {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.907331] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] nova.insecure = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.907470] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] nova.keyfile = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.907617] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] nova.region_name = RegionOne {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.907757] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] nova.split_loggers = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.907893] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] nova.timeout = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.908049] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] placement.auth_section = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.908201] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] placement.auth_type = password {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.908348] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.908487] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] placement.certfile = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.908627] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] placement.collect_timing = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.908774] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] placement.endpoint_type = public {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.908913] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] placement.insecure = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.909058] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] placement.keyfile = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.909194] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] placement.region_name = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.909331] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] placement.split_loggers = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.909467] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] placement.timeout = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.909611] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.auth_section = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.909748] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.auth_type = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.909884] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.cafile = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.910028] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.certfile = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.910168] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.collect_timing = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.910304] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.connect_retries = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.910443] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.connect_retry_delay = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.910582] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.enable_notifications = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.910715] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.endpoint_override = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.910854] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.insecure = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.910989] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.interface = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.911135] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.keyfile = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.911299] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.max_version = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.911436] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.min_version = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.911557] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.region_name = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.911692] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.retriable_status_codes = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.911825] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.service_name = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.911959] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.service_type = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.912114] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.split_loggers = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.912256] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.status_code_retries = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.912394] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.status_code_retry_delay = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.912546] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.timeout = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.912664] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.valid_interfaces = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.912801] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ironic.version = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.912945] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] cli_script.dry_run = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.913107] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.913247] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.913388] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.913524] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.913661] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.913805] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.913946] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.914098] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.914238] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.914386] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.914525] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.914669] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.914812] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.914951] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.915102] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.915251] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.915392] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.915530] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.915676] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.915814] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.915949] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.916103] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.916245] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.916385] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.916522] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.916657] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.916794] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.916928] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.917074] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.917214] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.917353] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.ssl = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.917504] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.917650] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.917790] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.917935] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.918088] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.ssl_version = {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.918229] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.918379] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_notifications.driver = [] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.918522] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_notifications.retry = -1 {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.918678] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.918816] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] oslo_messaging_notifications.transport_url = **** {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 593.918927] env[70535]: DEBUG oslo_service.backend.eventlet.service [None req-8690fc88-7fd0-46e8-af9a-79626b246d86 None None] ******************************************************************************** {{(pid=70535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 593.919955] env[70535]: DEBUG neutron.agent.securitygroups_rpc [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Init firewall settings (driver=nsxv3) {{(pid=70535) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 593.921376] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=70535) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 593.921543] env[70535]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] RPC agent_id: nsxm-l-01a.corp.local [ 593.923765] env[70535]: DEBUG dogpile.cache.region [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 593.923889] env[70535]: DEBUG dogpile.lock [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 593.923993] env[70535]: DEBUG dogpile.lock [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 593.924102] env[70535]: DEBUG dogpile.lock [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 593.924199] env[70535]: DEBUG dogpile.cache.region [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 593.924291] env[70535]: DEBUG dogpile.lock [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 593.924415] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 593.952706] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Session token - acquiring [ 593.954278] env[70535]: DEBUG networking_nsxv3.common.locking [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.954455] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.954545] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.954987] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.965891] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.239078] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 594.264161] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.264354] env[70535]: DEBUG dogpile.cache.region [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Cache value generated in 0.340 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 594.264495] env[70535]: DEBUG dogpile.lock [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.264632] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Activating Policy API Provider. [ 594.264837] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Looking for the default Infrastructure Rules. [ 594.336751] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Looking for the Default Layer3 Logged Drop Section. [ 594.353788] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 594.354228] env[70535]: DEBUG networking_nsxv3.common.locking [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.354451] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquiring lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.354527] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.354782] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired external semaphore "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.355130] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.872416] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.375086] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.877071] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Inventory metadata is going to be refreshed. [ 595.877481] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 596.789302] env[70535]: DEBUG networking_nsxv3.common.locking [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.789665] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.789665] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.789929] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.801718] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 596.802645] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.803662] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 596.826376] env[70535]: DEBUG networking_nsxv3.common.locking [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.826684] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.826762] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.827022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.827160] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.827316] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 596.827438] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 596.827547] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 596.848071] env[70535]: DEBUG networking_nsxv3.common.locking [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.848424] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.848424] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.848683] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.848872] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.849036] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 596.868392] env[70535]: DEBUG networking_nsxv3.common.locking [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.868743] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.868743] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.868986] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.869155] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.869320] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 596.888978] env[70535]: DEBUG networking_nsxv3.common.locking [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.889470] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquiring lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.889470] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.889607] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired external semaphore "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.889689] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Releasing lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.890029] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 596.890169] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 596.890282] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 596.908247] env[70535]: DEBUG networking_nsxv3.common.locking [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.908559] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquiring lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.908559] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.908823] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired external semaphore "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.908954] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Releasing lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.909112] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 596.909223] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 596.909338] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 596.933367] env[70535]: DEBUG networking_nsxv3.common.locking [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.933718] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.933718] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.933968] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.934130] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.934288] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 596.934427] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 596.934539] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Inventory metadata have been refreshed. [ 596.934643] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Dryrun:True. Metadata refresh completed. [ 596.934769] env[70535]: DEBUG oslo_concurrency.lockutils [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Releasing lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.936407] env[70535]: INFO neutron.agent.agent_extensions_manager [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Loaded agent extensions: [] [ 596.937136] env[70535]: DEBUG neutron_lib.callbacks.manager [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=70535) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 596.999969] env[70535]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] NSXv3 Agent Agent RPC Daemon Started! [ 597.000225] env[70535]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] NSXv3 Agent Agent loop - iteration:0 started [ 597.000225] env[70535]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] NSXv3 Agent Agent out of sync with plugin! [ 601.937464] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 601.937855] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 606.939086] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 606.939732] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 611.799687] env[70535]: INFO networking_nsxv3.common.synchronization [None req-a77b1e35-b170-4420-9567-7ae2814e1c00 demo admin] Enqueued Resource ID: 1acbb9a4-c3d9-4c49-b88d-f957724af71a with Priority: HIGHEST for action security_group_rules [ 611.800251] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1acbb9a4-c3d9-4c49-b88d-f957724af71a with Priority: HIGHEST for action security_group_rules [ 611.800651] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1acbb9a4-c3d9-4c49-b88d-f957724af71a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.800744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1acbb9a4-c3d9-4c49-b88d-f957724af71a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.800803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1acbb9a4-c3d9-4c49-b88d-f957724af71a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.801280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1acbb9a4-c3d9-4c49-b88d-f957724af71a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.801366] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1acbb9a4-c3d9-4c49-b88d-f957724af71a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.322623] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.322623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.322623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.322623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.322623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.322623] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1acbb9a4-c3d9-4c49-b88d-f957724af71a already deleted. [ 612.322623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1acbb9a4-c3d9-4c49-b88d-f957724af71a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.802019] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 616.802552] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 621.803446] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 621.803824] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 626.805061] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 626.805503] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 631.806234] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 631.806622] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 636.807906] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 636.808221] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 637.939793] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.940133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.940133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.940277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.940498] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.444111] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.949441] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.453501] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 639.453501] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 640.184955] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.185283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.185283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.185362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.202464] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 640.202464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.203414] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 640.225061] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.225224] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.225326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.225449] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.225535] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.225645] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 640.225716] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 640.225792] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 640.247408] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.247618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.247689] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.247844] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.247978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.248096] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 640.273212] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.273212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.273212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.273212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.273212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.273212] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 640.295023] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.295023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.295023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.295023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.295023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.295023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 640.295023] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 640.295023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 640.318276] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.318276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.318276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.318276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.318276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.318276] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 640.318276] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 640.318276] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 640.338690] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.338690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.338690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.338881] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.338881] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.338948] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 640.339030] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 640.339096] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 640.339161] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 640.340060] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 640.340060] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 640.340060] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 640.340060] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 640.340060] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 640.340060] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 640.361932] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.362108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.362295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.362444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.362515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.362593] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 640.385791] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.385967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.386023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.387252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.387252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.421442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.557868] env[70535]: INFO networking_nsxv3.common.synchronization [None req-b51c5124-cf7b-4788-9c9a-fb0e836fea80 None None] Enqueued Resource ID: 72cb68d5-ed4b-4a01-84f6-1f315dd66d2f with Priority: HIGHEST for action port [ 640.558151] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72cb68d5-ed4b-4a01-84f6-1f315dd66d2f with Priority: HIGHEST for action port [ 640.558711] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-72cb68d5-ed4b-4a01-84f6-1f315dd66d2f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.558834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72cb68d5-ed4b-4a01-84f6-1f315dd66d2f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.559254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72cb68d5-ed4b-4a01-84f6-1f315dd66d2f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.560894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72cb68d5-ed4b-4a01-84f6-1f315dd66d2f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.561370] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72cb68d5-ed4b-4a01-84f6-1f315dd66d2f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.062811] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72cb68d5-ed4b-4a01-84f6-1f315dd66d2f [ 641.063059] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.063386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.063386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.063467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.063557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.063648] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72cb68d5-ed4b-4a01-84f6-1f315dd66d2f already deleted. [ 641.063730] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72cb68d5-ed4b-4a01-84f6-1f315dd66d2f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.508118] env[70535]: INFO networking_nsxv3.common.synchronization [None req-d87557c5-7667-42f7-9fe1-4d86a2bb6a35 None None] Enqueued Resource ID: 69784882-d483-4a41-adb1-427b1e7e3098 with Priority: HIGHEST for action port [ 642.508118] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69784882-d483-4a41-adb1-427b1e7e3098 with Priority: HIGHEST for action port [ 642.508118] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-69784882-d483-4a41-adb1-427b1e7e3098 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.508118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69784882-d483-4a41-adb1-427b1e7e3098" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.508118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69784882-d483-4a41-adb1-427b1e7e3098" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.508118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69784882-d483-4a41-adb1-427b1e7e3098" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.508118] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69784882-d483-4a41-adb1-427b1e7e3098',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.011579] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69784882-d483-4a41-adb1-427b1e7e3098 [ 643.011905] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.012134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.012262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.012511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.012694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.013287] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69784882-d483-4a41-adb1-427b1e7e3098 already deleted. [ 643.013475] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69784882-d483-4a41-adb1-427b1e7e3098" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.300182] env[70535]: INFO networking_nsxv3.common.synchronization [None req-8b0778bf-e6c9-4b70-b84a-42ff393aed3d None None] Enqueued Resource ID: f97ee75f-d233-4c92-853c-340a38ae2409 with Priority: HIGHEST for action port [ 644.302557] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f97ee75f-d233-4c92-853c-340a38ae2409 with Priority: HIGHEST for action port [ 644.302557] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-f97ee75f-d233-4c92-853c-340a38ae2409 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.302557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f97ee75f-d233-4c92-853c-340a38ae2409" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.302557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f97ee75f-d233-4c92-853c-340a38ae2409" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.302557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f97ee75f-d233-4c92-853c-340a38ae2409" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.302557] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f97ee75f-d233-4c92-853c-340a38ae2409',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.807593] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f97ee75f-d233-4c92-853c-340a38ae2409 [ 644.808491] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.808491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.808491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.808491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.808491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.808491] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f97ee75f-d233-4c92-853c-340a38ae2409 already deleted. [ 644.808800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f97ee75f-d233-4c92-853c-340a38ae2409" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.838259] env[70535]: INFO networking_nsxv3.common.synchronization [None req-921ffd44-a4cd-4bfd-9c63-68749f0b81f8 None None] Enqueued Resource ID: 72d8bf11-8a2f-40de-8512-9ef34fd133e6 with Priority: HIGHEST for action port [ 644.838259] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72d8bf11-8a2f-40de-8512-9ef34fd133e6 with Priority: HIGHEST for action port [ 644.838657] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-72d8bf11-8a2f-40de-8512-9ef34fd133e6 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.838775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72d8bf11-8a2f-40de-8512-9ef34fd133e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.838835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72d8bf11-8a2f-40de-8512-9ef34fd133e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.839193] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72d8bf11-8a2f-40de-8512-9ef34fd133e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.839193] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72d8bf11-8a2f-40de-8512-9ef34fd133e6',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.974540] env[70535]: INFO networking_nsxv3.common.synchronization [None req-38a2648e-bc98-4c45-a2c2-2f41f21a91f1 None None] Enqueued Resource ID: 6566deb9-4dee-46d7-80da-63e175f9546c with Priority: HIGHEST for action port [ 644.974792] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6566deb9-4dee-46d7-80da-63e175f9546c with Priority: HIGHEST for action port [ 644.975358] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-6566deb9-4dee-46d7-80da-63e175f9546c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.975476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6566deb9-4dee-46d7-80da-63e175f9546c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.975541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6566deb9-4dee-46d7-80da-63e175f9546c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.975799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6566deb9-4dee-46d7-80da-63e175f9546c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.975877] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6566deb9-4dee-46d7-80da-63e175f9546c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.341885] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72d8bf11-8a2f-40de-8512-9ef34fd133e6 [ 645.342170] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.342265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.342379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.343089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.343089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.343089] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72d8bf11-8a2f-40de-8512-9ef34fd133e6 already deleted. [ 645.343089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72d8bf11-8a2f-40de-8512-9ef34fd133e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.478962] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6566deb9-4dee-46d7-80da-63e175f9546c [ 645.479280] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.479679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.479758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.479968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.480069] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.480203] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6566deb9-4dee-46d7-80da-63e175f9546c already deleted. [ 645.480527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6566deb9-4dee-46d7-80da-63e175f9546c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.119896] env[70535]: INFO networking_nsxv3.common.synchronization [None req-e098abef-a531-4ce6-959d-bd1f7484ba8b None None] Enqueued Resource ID: 2ba034db-c508-4523-9f3f-0b80ae197d32 with Priority: HIGHEST for action port [ 646.120173] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ba034db-c508-4523-9f3f-0b80ae197d32 with Priority: HIGHEST for action port [ 646.120724] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ba034db-c508-4523-9f3f-0b80ae197d32 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.120857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ba034db-c508-4523-9f3f-0b80ae197d32" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.120921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ba034db-c508-4523-9f3f-0b80ae197d32" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.124065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ba034db-c508-4523-9f3f-0b80ae197d32" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.124065] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ba034db-c508-4523-9f3f-0b80ae197d32',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.146100] env[70535]: INFO networking_nsxv3.common.synchronization [None req-52c87e41-2923-454c-8c9e-80a8d168a366 None None] Enqueued Resource ID: 99e7c9e9-bda4-4857-8a23-4eaf7503ec9c with Priority: HIGHEST for action port [ 646.146100] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e7c9e9-bda4-4857-8a23-4eaf7503ec9c with Priority: HIGHEST for action port [ 646.146100] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-99e7c9e9-bda4-4857-8a23-4eaf7503ec9c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.146100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99e7c9e9-bda4-4857-8a23-4eaf7503ec9c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.146100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99e7c9e9-bda4-4857-8a23-4eaf7503ec9c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.146100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99e7c9e9-bda4-4857-8a23-4eaf7503ec9c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.146433] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99e7c9e9-bda4-4857-8a23-4eaf7503ec9c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.515417] env[70535]: INFO networking_nsxv3.common.synchronization [None req-547292ce-6742-4de6-a247-581c7f91e49a None None] Enqueued Resource ID: faf59269-d46a-43f8-9f97-af12d69c73cc with Priority: HIGHEST for action port [ 646.515665] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faf59269-d46a-43f8-9f97-af12d69c73cc with Priority: HIGHEST for action port [ 646.516982] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-faf59269-d46a-43f8-9f97-af12d69c73cc taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.516982] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faf59269-d46a-43f8-9f97-af12d69c73cc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.516982] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faf59269-d46a-43f8-9f97-af12d69c73cc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.516982] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faf59269-d46a-43f8-9f97-af12d69c73cc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.518074] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faf59269-d46a-43f8-9f97-af12d69c73cc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.628327] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ba034db-c508-4523-9f3f-0b80ae197d32 [ 646.628759] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.628759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.628759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.628958] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.629102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.629155] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ba034db-c508-4523-9f3f-0b80ae197d32 already deleted. [ 646.629237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ba034db-c508-4523-9f3f-0b80ae197d32" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.651045] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99e7c9e9-bda4-4857-8a23-4eaf7503ec9c [ 646.651588] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.651588] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.651588] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.651739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.651774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.652936] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99e7c9e9-bda4-4857-8a23-4eaf7503ec9c already deleted. [ 646.655410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99e7c9e9-bda4-4857-8a23-4eaf7503ec9c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.020352] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port faf59269-d46a-43f8-9f97-af12d69c73cc [ 647.020576] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.020713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.020803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.020997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.021237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.021237] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:faf59269-d46a-43f8-9f97-af12d69c73cc already deleted. [ 647.021326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faf59269-d46a-43f8-9f97-af12d69c73cc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.207941] env[70535]: INFO networking_nsxv3.common.synchronization [None req-ad5f5b4a-71b4-4c1b-a667-6cca8988f56a None None] Enqueued Resource ID: 285533ae-ff95-4bef-a0c0-88fc1999bcf1 with Priority: HIGHEST for action port [ 647.208885] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 285533ae-ff95-4bef-a0c0-88fc1999bcf1 with Priority: HIGHEST for action port [ 647.209436] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-285533ae-ff95-4bef-a0c0-88fc1999bcf1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.209436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-285533ae-ff95-4bef-a0c0-88fc1999bcf1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.212102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-285533ae-ff95-4bef-a0c0-88fc1999bcf1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.212102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-285533ae-ff95-4bef-a0c0-88fc1999bcf1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.212102] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('285533ae-ff95-4bef-a0c0-88fc1999bcf1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.714155] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 285533ae-ff95-4bef-a0c0-88fc1999bcf1 [ 647.714423] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.714594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.714594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.714789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.714880] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.714974] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:285533ae-ff95-4bef-a0c0-88fc1999bcf1 already deleted. [ 647.715065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-285533ae-ff95-4bef-a0c0-88fc1999bcf1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.128317] env[70535]: INFO networking_nsxv3.common.synchronization [None req-ee620de7-0787-4fb9-9431-a35341c753ce None None] Enqueued Resource ID: b93fa685-6b01-44c0-8ee2-7fda1bd9a194 with Priority: HIGHEST for action port [ 648.128317] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b93fa685-6b01-44c0-8ee2-7fda1bd9a194 with Priority: HIGHEST for action port [ 648.128317] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-b93fa685-6b01-44c0-8ee2-7fda1bd9a194 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.128317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b93fa685-6b01-44c0-8ee2-7fda1bd9a194" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.128317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b93fa685-6b01-44c0-8ee2-7fda1bd9a194" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.128317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b93fa685-6b01-44c0-8ee2-7fda1bd9a194" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.128317] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b93fa685-6b01-44c0-8ee2-7fda1bd9a194',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.346180] env[70535]: INFO networking_nsxv3.common.synchronization [None req-25eb4dad-81dd-4aa3-b270-8f3c8ceb62c9 None None] Enqueued Resource ID: 1d10bfa2-1f42-45dc-bcf0-93ac2d9f1f48 with Priority: HIGHEST for action port [ 648.348097] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d10bfa2-1f42-45dc-bcf0-93ac2d9f1f48 with Priority: HIGHEST for action port [ 648.348097] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d10bfa2-1f42-45dc-bcf0-93ac2d9f1f48 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.348097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d10bfa2-1f42-45dc-bcf0-93ac2d9f1f48" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.348097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d10bfa2-1f42-45dc-bcf0-93ac2d9f1f48" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.348097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d10bfa2-1f42-45dc-bcf0-93ac2d9f1f48" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.348097] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d10bfa2-1f42-45dc-bcf0-93ac2d9f1f48',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.634145] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b93fa685-6b01-44c0-8ee2-7fda1bd9a194 [ 648.634410] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.634618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.635373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.635373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.635373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.635373] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b93fa685-6b01-44c0-8ee2-7fda1bd9a194 already deleted. [ 648.635520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b93fa685-6b01-44c0-8ee2-7fda1bd9a194" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.852510] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d10bfa2-1f42-45dc-bcf0-93ac2d9f1f48 [ 648.852840] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.853069] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.853168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.854772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.854956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.855345] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d10bfa2-1f42-45dc-bcf0-93ac2d9f1f48 already deleted. [ 648.855945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d10bfa2-1f42-45dc-bcf0-93ac2d9f1f48" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.148678] env[70535]: INFO networking_nsxv3.common.synchronization [None req-c49b4d57-ca17-4a40-b6d6-670ddf2ab1b8 None None] Enqueued Resource ID: 9a5ea56a-af5c-4437-966f-de47dbff646f with Priority: HIGHEST for action port [ 649.148934] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a5ea56a-af5c-4437-966f-de47dbff646f with Priority: HIGHEST for action port [ 649.149503] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a5ea56a-af5c-4437-966f-de47dbff646f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.149622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a5ea56a-af5c-4437-966f-de47dbff646f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.149686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a5ea56a-af5c-4437-966f-de47dbff646f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.149952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a5ea56a-af5c-4437-966f-de47dbff646f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.150294] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a5ea56a-af5c-4437-966f-de47dbff646f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.653712] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a5ea56a-af5c-4437-966f-de47dbff646f [ 649.653712] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.653712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.653712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.653712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.653712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.653712] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a5ea56a-af5c-4437-966f-de47dbff646f already deleted. [ 649.653712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a5ea56a-af5c-4437-966f-de47dbff646f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.939233] env[70535]: INFO networking_nsxv3.common.synchronization [None req-c4fb7b70-5eba-4425-9c64-59ff7e5427fc None None] Enqueued Resource ID: be531638-00fd-4163-82ee-b40b1658f3f7 with Priority: HIGHEST for action port [ 649.939849] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be531638-00fd-4163-82ee-b40b1658f3f7 with Priority: HIGHEST for action port [ 649.941085] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-be531638-00fd-4163-82ee-b40b1658f3f7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.941085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be531638-00fd-4163-82ee-b40b1658f3f7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.941233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be531638-00fd-4163-82ee-b40b1658f3f7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.941771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be531638-00fd-4163-82ee-b40b1658f3f7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.942103] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be531638-00fd-4163-82ee-b40b1658f3f7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.268379] env[70535]: INFO networking_nsxv3.common.synchronization [None req-be094f89-abd3-4322-a83b-0221e33d3840 None None] Enqueued Resource ID: df53fcc8-d9ac-4ffa-a713-f44549cb1bbf with Priority: HIGHEST for action port [ 650.268907] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df53fcc8-d9ac-4ffa-a713-f44549cb1bbf with Priority: HIGHEST for action port [ 650.269307] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-df53fcc8-d9ac-4ffa-a713-f44549cb1bbf taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.269410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df53fcc8-d9ac-4ffa-a713-f44549cb1bbf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.269446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df53fcc8-d9ac-4ffa-a713-f44549cb1bbf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.269753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df53fcc8-d9ac-4ffa-a713-f44549cb1bbf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.269828] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df53fcc8-d9ac-4ffa-a713-f44549cb1bbf',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.446250] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be531638-00fd-4163-82ee-b40b1658f3f7 [ 650.446538] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.446627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.446723] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.447086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.447086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.447086] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be531638-00fd-4163-82ee-b40b1658f3f7 already deleted. [ 650.447216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be531638-00fd-4163-82ee-b40b1658f3f7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.552883] env[70535]: INFO networking_nsxv3.common.synchronization [None req-aef3dc7d-859b-4ce1-9978-abd0c2fcbb6a None None] Enqueued Resource ID: 218e5056-132d-4381-a781-10dc04182d96 with Priority: HIGHEST for action port [ 650.553503] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 218e5056-132d-4381-a781-10dc04182d96 with Priority: HIGHEST for action port [ 650.553883] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-218e5056-132d-4381-a781-10dc04182d96 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.554018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-218e5056-132d-4381-a781-10dc04182d96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.555513] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-218e5056-132d-4381-a781-10dc04182d96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.555700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-218e5056-132d-4381-a781-10dc04182d96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.555794] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('218e5056-132d-4381-a781-10dc04182d96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.776609] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df53fcc8-d9ac-4ffa-a713-f44549cb1bbf [ 650.776831] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.777659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.777659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.777659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.777659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.777659] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df53fcc8-d9ac-4ffa-a713-f44549cb1bbf already deleted. [ 650.777659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df53fcc8-d9ac-4ffa-a713-f44549cb1bbf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.058925] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 218e5056-132d-4381-a781-10dc04182d96 [ 651.059220] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.059365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.059432] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.059672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.061058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.061058] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:218e5056-132d-4381-a781-10dc04182d96 already deleted. [ 651.061058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-218e5056-132d-4381-a781-10dc04182d96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.516911] env[70535]: INFO networking_nsxv3.common.synchronization [None req-ebaee833-faa2-43a5-9832-c757d9496665 tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_rules [ 651.516911] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_rules [ 651.516911] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-597eb346-7afe-45b2-a812-9f2a8e62680f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.516911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.516911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.516911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.517303] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.742437] env[70535]: INFO networking_nsxv3.common.synchronization [None req-f79185c8-5f7a-4a6b-a6ed-009e53f44daf tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_rules [ 651.742999] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_rules [ 651.747141] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-597eb346-7afe-45b2-a812-9f2a8e62680f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.747207] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.041819] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.043687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.043687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.043687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.043687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.043687] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 597eb346-7afe-45b2-a812-9f2a8e62680f already deleted. [ 652.043687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.043687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.043687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.043687] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.313655] env[70535]: INFO networking_nsxv3.common.synchronization [None req-dc87b5d9-5c6e-42dd-868d-4650dd72e795 None None] Enqueued Resource ID: ee8d95ed-a943-4b68-afa7-8e0d7de47b7c with Priority: HIGHEST for action port [ 652.314279] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8d95ed-a943-4b68-afa7-8e0d7de47b7c with Priority: HIGHEST for action port [ 652.314606] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee8d95ed-a943-4b68-afa7-8e0d7de47b7c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.314750] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee8d95ed-a943-4b68-afa7-8e0d7de47b7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.314819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee8d95ed-a943-4b68-afa7-8e0d7de47b7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.315123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee8d95ed-a943-4b68-afa7-8e0d7de47b7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.315211] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee8d95ed-a943-4b68-afa7-8e0d7de47b7c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.341274] env[70535]: INFO networking_nsxv3.common.synchronization [None req-ab39bf87-8f97-4e7b-a262-c382aa97001b None None] Enqueued Resource ID: 1e1b4fbe-999d-44f4-be5b-22daca7f50fc with Priority: HIGHEST for action port [ 652.341472] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e1b4fbe-999d-44f4-be5b-22daca7f50fc with Priority: HIGHEST for action port [ 652.342228] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e1b4fbe-999d-44f4-be5b-22daca7f50fc taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.342228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e1b4fbe-999d-44f4-be5b-22daca7f50fc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.342318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e1b4fbe-999d-44f4-be5b-22daca7f50fc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.342541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e1b4fbe-999d-44f4-be5b-22daca7f50fc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.342644] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e1b4fbe-999d-44f4-be5b-22daca7f50fc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.505377] env[70535]: INFO networking_nsxv3.common.synchronization [req-d6d235a0-af78-43cd-93b5-599033045786 req-1e874b13-317c-4064-8a94-51de7e7ac6a1 tempest-DeleteServersAdminTestJSON-21744185 tempest-DeleteServersAdminTestJSON-21744185-project-member] Enqueued Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_members [ 652.505912] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_members [ 652.506228] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.506350] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.506417] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.506657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.506803] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.506900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.506957] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.508182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.508409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.508409] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.565390] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.565390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.565390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.565390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.565390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.565390] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 597eb346-7afe-45b2-a812-9f2a8e62680f already deleted. [ 652.565390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.818304] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee8d95ed-a943-4b68-afa7-8e0d7de47b7c [ 652.818304] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.818304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.818304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.818304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.818304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.818674] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee8d95ed-a943-4b68-afa7-8e0d7de47b7c already deleted. [ 652.818674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee8d95ed-a943-4b68-afa7-8e0d7de47b7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.846588] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e1b4fbe-999d-44f4-be5b-22daca7f50fc [ 652.846702] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.847115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.847115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.847248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.847248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.847812] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e1b4fbe-999d-44f4-be5b-22daca7f50fc already deleted. [ 652.847812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e1b4fbe-999d-44f4-be5b-22daca7f50fc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.010779] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.010939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.011019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.011242] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.011336] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.011640] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.011759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.011823] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.012025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.012113] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.012205] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 already deleted. [ 653.012293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.363685] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.363685] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.363685] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.363685] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.365799] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.366086] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.366303] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.366612] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.368309] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.368309] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.368309] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.368309] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.368309] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.368309] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.368309] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.368309] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.388853] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.389575] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 653.389833] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.390059] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.390399] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.390584] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.390706] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.391309] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.391511] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.458015] env[70535]: INFO networking_nsxv3.common.synchronization [None req-36da6e3d-c0cc-43db-91aa-24040ae2a4b4 None None] Enqueued Resource ID: 3e68d933-dbab-4b97-b2ff-fbf711e7e2a2 with Priority: HIGHEST for action port [ 653.458492] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e68d933-dbab-4b97-b2ff-fbf711e7e2a2 with Priority: HIGHEST for action port [ 653.459601] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e68d933-dbab-4b97-b2ff-fbf711e7e2a2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.459601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e68d933-dbab-4b97-b2ff-fbf711e7e2a2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.460872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e68d933-dbab-4b97-b2ff-fbf711e7e2a2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.461169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e68d933-dbab-4b97-b2ff-fbf711e7e2a2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.461269] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e68d933-dbab-4b97-b2ff-fbf711e7e2a2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.895841] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.895841] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.895841] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.895841] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.895841] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.896074] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7 not found, creating... [ 653.896314] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.896478] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.896662] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.896824] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.896964] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.897355] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.897531] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.897667] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.897889] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.899945] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.900048] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7 is going to be created. [ 653.930496] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.930496] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.930496] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.930496] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.930496] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.930496] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.966278] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e68d933-dbab-4b97-b2ff-fbf711e7e2a2 [ 653.968167] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.968167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.968167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.968167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.968167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.968167] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e68d933-dbab-4b97-b2ff-fbf711e7e2a2 already deleted. [ 653.968167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e68d933-dbab-4b97-b2ff-fbf711e7e2a2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.750977] env[70535]: INFO networking_nsxv3.common.synchronization [None req-0f6d8983-04c3-4c69-92c5-68f40ec47011 None None] Enqueued Resource ID: 3dae4322-e756-4df3-8a87-ec70bb71dc5d with Priority: HIGHEST for action port [ 655.751720] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dae4322-e756-4df3-8a87-ec70bb71dc5d with Priority: HIGHEST for action port [ 655.752586] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dae4322-e756-4df3-8a87-ec70bb71dc5d taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.752586] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dae4322-e756-4df3-8a87-ec70bb71dc5d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.755587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dae4322-e756-4df3-8a87-ec70bb71dc5d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.755587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dae4322-e756-4df3-8a87-ec70bb71dc5d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.755587] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dae4322-e756-4df3-8a87-ec70bb71dc5d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.817020] env[70535]: INFO networking_nsxv3.common.synchronization [req-d6d235a0-af78-43cd-93b5-599033045786 req-3759a82c-3fd2-41dc-b1df-524e5aa80378 service nova] Enqueued Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_rules [ 655.817796] env[70535]: INFO networking_nsxv3.common.synchronization [req-d6d235a0-af78-43cd-93b5-599033045786 req-3759a82c-3fd2-41dc-b1df-524e5aa80378 service nova] Enqueued Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_members [ 655.821729] env[70535]: INFO networking_nsxv3.common.synchronization [req-d6d235a0-af78-43cd-93b5-599033045786 req-3759a82c-3fd2-41dc-b1df-524e5aa80378 service nova] Enqueued Resource ID: 9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7 with Priority: HIGHEST for action port [ 655.822393] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_rules [ 655.822769] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_members [ 655.822769] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7 with Priority: HIGHEST for action port [ 655.822986] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.823087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.823128] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.823379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.823501] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.824338] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.824460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.824528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.824702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.824864] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.824946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.825024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.825164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.825249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.825341] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.827640] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.827758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.827828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.827990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.828083] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.257659] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3dae4322-e756-4df3-8a87-ec70bb71dc5d [ 656.258249] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.258362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.258409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.258855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.258855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.259034] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3dae4322-e756-4df3-8a87-ec70bb71dc5d already deleted. [ 656.259136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dae4322-e756-4df3-8a87-ec70bb71dc5d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.330995] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.330995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.343809] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7 with status ACTIVE [ 656.344957] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.345167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.345271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.345549] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.345688] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.346746] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.346905] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.347011] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.347218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.347397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.347589] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.348079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.348249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.349270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.349385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.349510] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7 is going to be updated. [ 656.350750] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.376474] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.376667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.376768] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.377074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.377256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.377448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a8ed272-01b0-41bd-9d2d-c3c3ce6292d7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.853090] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.088110] env[70535]: INFO networking_nsxv3.common.synchronization [req-f98d124e-ecb3-41a8-af89-ad88c5a2f9dd req-4d1406ce-8dc9-4a9c-b315-8e021142a732 tempest-AttachInterfacesV270Test-47759930 tempest-AttachInterfacesV270Test-47759930-project-member] Enqueued Resource ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 with Priority: HIGHEST for action security_group_members [ 657.088976] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 with Priority: HIGHEST for action security_group_members [ 657.088976] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-679d2a4f-8236-41e0-99ab-1f6326515c29 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.089406] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.089406] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.089518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.089595] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.089692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.089766] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.089927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.090022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.090117] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('679d2a4f-8236-41e0-99ab-1f6326515c29',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.357018] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.357186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.357592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.357592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.357592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.357743] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 is going to be created. [ 657.413130] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.413293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.413352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.414896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.414896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.426874] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 in Status: UNINITIALIZED for 2s [ 657.593758] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.593954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.594073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.594594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.594699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.594914] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.595038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.595087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.596449] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.596542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.596641] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 already deleted. [ 657.596729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.883945] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-374 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.884340] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-374" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.884988] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-374" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.884988] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-374" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.887125] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.887125] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.887125] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.887125] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.887125] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.887125] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 657.887497] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.887497] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.887561] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.888242] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 657.888242] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.888242] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.908114] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.908248] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 657.910030] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.910030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-374" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.910030] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-f30adabd-c1e3-463d-a1d6-dc2b120cef19 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.910030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-f30adabd-c1e3-463d-a1d6-dc2b120cef19" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.910030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-f30adabd-c1e3-463d-a1d6-dc2b120cef19" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.910030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-f30adabd-c1e3-463d-a1d6-dc2b120cef19" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.910030] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f30adabd-c1e3-463d-a1d6-dc2b120cef19',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.306353] env[70535]: INFO networking_nsxv3.common.synchronization [None req-27eb4487-9576-4131-b7c3-57039c376b20 None None] Enqueued Resource ID: d5e628bf-16a3-4152-84ad-af3b0b8ebed4 with Priority: HIGHEST for action port [ 658.306353] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5e628bf-16a3-4152-84ad-af3b0b8ebed4 with Priority: HIGHEST for action port [ 658.306712] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5e628bf-16a3-4152-84ad-af3b0b8ebed4 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.309970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5e628bf-16a3-4152-84ad-af3b0b8ebed4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.309970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5e628bf-16a3-4152-84ad-af3b0b8ebed4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.312146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5e628bf-16a3-4152-84ad-af3b0b8ebed4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.312146] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5e628bf-16a3-4152-84ad-af3b0b8ebed4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.414075] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.414075] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.414278] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.414691] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.414691] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.415372] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port f30adabd-c1e3-463d-a1d6-dc2b120cef19 not found, creating... [ 658.415870] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.416076] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.416472] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.416700] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.417551] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.417551] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.417551] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.417551] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.417913] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.417913] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.418099] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: f30adabd-c1e3-463d-a1d6-dc2b120cef19 is going to be created. [ 658.445027] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.445027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.445027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.445027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.445027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.445027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-f30adabd-c1e3-463d-a1d6-dc2b120cef19" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.818407] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5e628bf-16a3-4152-84ad-af3b0b8ebed4 [ 658.821788] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.821788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.821788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.821788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.821788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.821788] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5e628bf-16a3-4152-84ad-af3b0b8ebed4 already deleted. [ 658.821788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5e628bf-16a3-4152-84ad-af3b0b8ebed4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.438640] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 in Status: SUCCESS [ 659.438932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.439071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.439292] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.439977] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.439977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.439977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.439977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.439977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.439977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.440258] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.816418] env[70535]: INFO networking_nsxv3.common.synchronization [None req-736c555a-b005-4182-9aec-6880a204cb98 None None] Enqueued Resource ID: 6cf2c5ee-b650-49b8-a4d1-cf48c0597dd9 with Priority: HIGHEST for action port [ 659.817181] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cf2c5ee-b650-49b8-a4d1-cf48c0597dd9 with Priority: HIGHEST for action port [ 659.817489] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cf2c5ee-b650-49b8-a4d1-cf48c0597dd9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.817628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cf2c5ee-b650-49b8-a4d1-cf48c0597dd9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.817673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cf2c5ee-b650-49b8-a4d1-cf48c0597dd9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.821048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cf2c5ee-b650-49b8-a4d1-cf48c0597dd9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.821048] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cf2c5ee-b650-49b8-a4d1-cf48c0597dd9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.876572] env[70535]: INFO networking_nsxv3.common.synchronization [req-9e8444f1-c8d4-41ac-87f9-c5589ccc3190 req-b18a1ca7-9ff5-4c9d-941d-b818b00321ac tempest-FloatingIPsAssociationTestJSON-570582915 tempest-FloatingIPsAssociationTestJSON-570582915-project-member] Enqueued Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_members [ 659.877535] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_members [ 659.878253] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.878418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.878487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.878738] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.878955] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.879084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.879334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.879655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.879749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.880128] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.943450] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.943450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.943450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.943450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.943643] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.943705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.943736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.943871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.944025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.944116] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.944275] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.944387] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.944490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.944606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.944745] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.944854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.944895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.945093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.945233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.945278] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.945336] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.953744] env[70535]: INFO networking_nsxv3.common.synchronization [req-f98d124e-ecb3-41a8-af89-ad88c5a2f9dd req-edceb4c4-6f39-4c11-ae65-6758e1ad1b14 service nova] Enqueued Resource ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 with Priority: HIGHEST for action security_group_rules [ 659.953890] env[70535]: INFO networking_nsxv3.common.synchronization [req-f98d124e-ecb3-41a8-af89-ad88c5a2f9dd req-edceb4c4-6f39-4c11-ae65-6758e1ad1b14 service nova] Enqueued Resource ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 with Priority: HIGHEST for action security_group_members [ 659.953929] env[70535]: INFO networking_nsxv3.common.synchronization [req-f98d124e-ecb3-41a8-af89-ad88c5a2f9dd req-edceb4c4-6f39-4c11-ae65-6758e1ad1b14 service nova] Enqueued Resource ID: f30adabd-c1e3-463d-a1d6-dc2b120cef19 with Priority: HIGHEST for action port [ 659.954642] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 with Priority: HIGHEST for action security_group_rules [ 659.954778] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 with Priority: HIGHEST for action security_group_members [ 659.954873] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f30adabd-c1e3-463d-a1d6-dc2b120cef19 with Priority: HIGHEST for action port [ 659.955227] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-679d2a4f-8236-41e0-99ab-1f6326515c29 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.955399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.955441] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.955929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.956528] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('679d2a4f-8236-41e0-99ab-1f6326515c29',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.957492] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-679d2a4f-8236-41e0-99ab-1f6326515c29 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.957642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.957699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.958502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.958502] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.958502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.958502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.958502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.958713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.958713] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('679d2a4f-8236-41e0-99ab-1f6326515c29',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.959575] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-f30adabd-c1e3-463d-a1d6-dc2b120cef19 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.959686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f30adabd-c1e3-463d-a1d6-dc2b120cef19" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.959763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f30adabd-c1e3-463d-a1d6-dc2b120cef19" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.959915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f30adabd-c1e3-463d-a1d6-dc2b120cef19" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.960015] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f30adabd-c1e3-463d-a1d6-dc2b120cef19',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.322862] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cf2c5ee-b650-49b8-a4d1-cf48c0597dd9 [ 660.323675] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.324353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.325225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.326627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.326873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.329177] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cf2c5ee-b650-49b8-a4d1-cf48c0597dd9 already deleted. [ 660.329177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cf2c5ee-b650-49b8-a4d1-cf48c0597dd9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.382618] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.382797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.382852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.383162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.383418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.383486] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.383548] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.383611] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.384191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.384191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.384191] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b34086e-8eac-4499-9c02-2280b24b0698 already deleted. [ 660.384191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.447883] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbb53f03-8f48-4baa-b4e6-67243ad60187: rpc.has_security_group_logging(os_id): False [ 660.462154] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-679d2a4f-8236-41e0-99ab-1f6326515c29 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.462343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.462491] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('679d2a4f-8236-41e0-99ab-1f6326515c29',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.463499] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f30adabd-c1e3-463d-a1d6-dc2b120cef19 with status ACTIVE [ 660.464854] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.464854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.464854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.464854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.465100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.466149] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.466149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.466149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.466149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.466149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.466149] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.466149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.466149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.466149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.466149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.466149] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f30adabd-c1e3-463d-a1d6-dc2b120cef19 is going to be updated. [ 660.468822] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.468939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.468983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.469165] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.469243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.469482] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.469561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.469598] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.469717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.469803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.470017] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.470130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.470190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.470336] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.470405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.470580] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.470665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.470727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.470862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.470932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.471024] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 is going to be created. [ 660.501088] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.501225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.501292] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.501506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.501634] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.502249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f30adabd-c1e3-463d-a1d6-dc2b120cef19" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.546829] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.547025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.548625] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.548625] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.548625] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.565008] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 in Status: IN_PROGRESS for 2s [ 660.974216] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('679d2a4f-8236-41e0-99ab-1f6326515c29',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.179620] env[70535]: INFO networking_nsxv3.common.synchronization [None req-695681e0-ea4f-4873-8189-69f26d4c63b8 None None] Enqueued Resource ID: d05864e5-ecdf-410b-a286-48bd41651d5d with Priority: HIGHEST for action port [ 661.182806] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d05864e5-ecdf-410b-a286-48bd41651d5d with Priority: HIGHEST for action port [ 661.183321] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-d05864e5-ecdf-410b-a286-48bd41651d5d taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.183849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d05864e5-ecdf-410b-a286-48bd41651d5d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.183849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d05864e5-ecdf-410b-a286-48bd41651d5d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.184025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d05864e5-ecdf-410b-a286-48bd41651d5d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.184216] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d05864e5-ecdf-410b-a286-48bd41651d5d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.476117] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.476420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.476420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.476587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.476681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.476781] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 is going to be created. [ 661.504019] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.504592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.504772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.504914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.505168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.516601] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 in Status: UNINITIALIZED for 2s [ 661.552978] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.554540] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.554540] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.554764] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.555814] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.556091] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.556302] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.556597] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.556784] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.557018] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.557147] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.557251] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.557377] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.557498] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.557605] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.557736] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.586565] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.586565] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 661.586715] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.586883] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.587304] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-b1a49ba0-9356-4d7f-a517-980d6a2553c8 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.587525] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-b1a49ba0-9356-4d7f-a517-980d6a2553c8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.587643] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-b1a49ba0-9356-4d7f-a517-980d6a2553c8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.588051] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-b1a49ba0-9356-4d7f-a517-980d6a2553c8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.588517] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1a49ba0-9356-4d7f-a517-980d6a2553c8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.687282] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d05864e5-ecdf-410b-a286-48bd41651d5d [ 661.689087] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.689087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.689087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.689087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.689087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.689087] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d05864e5-ecdf-410b-a286-48bd41651d5d already deleted. [ 661.689087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d05864e5-ecdf-410b-a286-48bd41651d5d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.091538] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.092996] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.093146] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.093480] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.094757] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.094757] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port b1a49ba0-9356-4d7f-a517-980d6a2553c8 not found, creating... [ 662.094757] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.094757] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.094757] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.094757] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.094757] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.095282] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.095282] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.095364] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.097234] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.097355] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.097523] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: b1a49ba0-9356-4d7f-a517-980d6a2553c8 is going to be created. [ 662.117660] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.117973] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.118185] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.118595] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.118978] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.119400] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-b1a49ba0-9356-4d7f-a517-980d6a2553c8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.543752] env[70535]: INFO networking_nsxv3.common.synchronization [req-cbdb4e59-45a3-460c-b1b9-6181dc944238 req-8e4e6fe2-51b7-463d-9bc6-810a7d92f785 tempest-ServerDiagnosticsTest-1292803537 tempest-ServerDiagnosticsTest-1292803537-project-member] Enqueued Resource ID: 81327d43-2c13-4e7b-b63b-d04a175b637e with Priority: HIGHEST for action security_group_members [ 662.544695] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81327d43-2c13-4e7b-b63b-d04a175b637e with Priority: HIGHEST for action security_group_members [ 662.544850] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-81327d43-2c13-4e7b-b63b-d04a175b637e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.545528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.545652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.546121] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.546194] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.546360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.546447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.546640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.546753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.546921] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81327d43-2c13-4e7b-b63b-d04a175b637e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.581501] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 in Status: SUCCESS [ 662.581927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.028288] env[70535]: INFO networking_nsxv3.common.synchronization [None req-5d186ad8-e5dd-4693-82a9-bc6eb60f8e0e None None] Enqueued Resource ID: 2fa9a875-49e9-42bd-80b0-d9efa0af1df1 with Priority: HIGHEST for action port [ 663.028288] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa9a875-49e9-42bd-80b0-d9efa0af1df1 with Priority: HIGHEST for action port [ 663.031107] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fa9a875-49e9-42bd-80b0-d9efa0af1df1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.031334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fa9a875-49e9-42bd-80b0-d9efa0af1df1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.031445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fa9a875-49e9-42bd-80b0-d9efa0af1df1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.032353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fa9a875-49e9-42bd-80b0-d9efa0af1df1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.032353] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fa9a875-49e9-42bd-80b0-d9efa0af1df1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.051259] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.051632] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.051708] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.052038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.052218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.052536] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.052719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.052881] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.053150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.054021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.054141] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81327d43-2c13-4e7b-b63b-d04a175b637e already deleted. [ 663.054264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.350354] env[70535]: INFO networking_nsxv3.common.synchronization [req-9e8444f1-c8d4-41ac-87f9-c5589ccc3190 req-140866b8-1bdb-4c1a-8ae2-1eacaa2918d8 service nova] Enqueued Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_rules [ 663.350535] env[70535]: INFO networking_nsxv3.common.synchronization [req-9e8444f1-c8d4-41ac-87f9-c5589ccc3190 req-140866b8-1bdb-4c1a-8ae2-1eacaa2918d8 service nova] Enqueued Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_members [ 663.350874] env[70535]: INFO networking_nsxv3.common.synchronization [req-9e8444f1-c8d4-41ac-87f9-c5589ccc3190 req-140866b8-1bdb-4c1a-8ae2-1eacaa2918d8 service nova] Enqueued Resource ID: b1a49ba0-9356-4d7f-a517-980d6a2553c8 with Priority: HIGHEST for action port [ 663.351820] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_rules [ 663.353060] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_members [ 663.353148] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a49ba0-9356-4d7f-a517-980d6a2553c8 with Priority: HIGHEST for action port [ 663.353408] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.353547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.353833] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.353913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.353988] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.354861] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.355025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.355073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.355259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.355668] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.355668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.355668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.355834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.355834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.355887] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.357855] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1a49ba0-9356-4d7f-a517-980d6a2553c8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.357947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1a49ba0-9356-4d7f-a517-980d6a2553c8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.357999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1a49ba0-9356-4d7f-a517-980d6a2553c8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.358234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1a49ba0-9356-4d7f-a517-980d6a2553c8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.358292] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1a49ba0-9356-4d7f-a517-980d6a2553c8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.528176] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 in Status: SUCCESS [ 663.528425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.528957] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.529269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.529374] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.529517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.529571] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.529727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.529791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.529890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.530375] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('679d2a4f-8236-41e0-99ab-1f6326515c29',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.534171] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fa9a875-49e9-42bd-80b0-d9efa0af1df1 [ 663.534381] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.534505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.534572] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.534745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.534851] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.534905] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fa9a875-49e9-42bd-80b0-d9efa0af1df1 already deleted. [ 663.534990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fa9a875-49e9-42bd-80b0-d9efa0af1df1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.799695] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.800053] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.800053] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.800305] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.800576] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.800912] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.801083] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.802032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.802032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.802032] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 663.802267] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.802369] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.802484] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.802604] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 663.802752] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.802987] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.822550] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.823253] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 663.823482] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.823681] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.824053] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-62810186-00c9-4f73-a5b5-e96c4ef94ad3 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.824244] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-62810186-00c9-4f73-a5b5-e96c4ef94ad3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.824809] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-62810186-00c9-4f73-a5b5-e96c4ef94ad3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.824809] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-62810186-00c9-4f73-a5b5-e96c4ef94ad3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.824916] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62810186-00c9-4f73-a5b5-e96c4ef94ad3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.861431] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.861431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.862450] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.869183] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1a49ba0-9356-4d7f-a517-980d6a2553c8 with status ACTIVE [ 663.869183] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.869183] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.869183] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.869183] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.869183] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.869183] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.869183] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.869741] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.869741] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.869741] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.869741] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.869889] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.869889] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.869950] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.872410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.872410] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1a49ba0-9356-4d7f-a517-980d6a2553c8 is going to be updated. [ 663.902769] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.902769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.902769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.902769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.902769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.902769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1a49ba0-9356-4d7f-a517-980d6a2553c8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.032605] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-679d2a4f-8236-41e0-99ab-1f6326515c29 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.032772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.032826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.033065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.033287] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.033411] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.033465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.033629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.033717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.033805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.033954] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-679d2a4f-8236-41e0-99ab-1f6326515c29 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.034065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.034153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.034374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.034532] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.034629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.034692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.034837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.034915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.035007] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.035106] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('679d2a4f-8236-41e0-99ab-1f6326515c29',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.223593] env[70535]: INFO networking_nsxv3.common.synchronization [req-dfb6cdd4-9773-4686-a6f9-e6a39bb9576a req-4990a3e4-093d-4e82-9639-c53be762852d tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_members [ 664.224701] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_members [ 664.224701] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-597eb346-7afe-45b2-a812-9f2a8e62680f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.224701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.224701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.224861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.226016] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.226016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.226016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.226016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.226016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.226016] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.328763] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.328996] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.329205] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.329396] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.329552] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.330074] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 62810186-00c9-4f73-a5b5-e96c4ef94ad3 not found, creating... [ 664.330074] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.330222] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.330261] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.330489] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.330653] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.330900] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.331064] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.331202] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.331403] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.331535] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.331670] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 62810186-00c9-4f73-a5b5-e96c4ef94ad3 is going to be created. [ 664.355388] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.355617] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.355750] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.356123] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.356540] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.356636] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-62810186-00c9-4f73-a5b5-e96c4ef94ad3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.376811] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.542686] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 679d2a4f-8236-41e0-99ab-1f6326515c29: rpc.has_security_group_logging(os_id): False [ 664.561925] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.561925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.561925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.561925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.561925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.562251] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.562251] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.562251] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.563115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.563115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.563115] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.563115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.563115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.563115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.563115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.564098] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.564377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.564466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.564652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.564754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.566286] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 is going to be created. [ 664.578681] env[70535]: INFO networking_nsxv3.common.synchronization [None req-2b1c1cac-ec51-427d-90f2-2fa98f863720 None None] Enqueued Resource ID: 633b2827-d754-4235-8781-d7f11d7de36b with Priority: HIGHEST for action port [ 664.578681] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 633b2827-d754-4235-8781-d7f11d7de36b with Priority: HIGHEST for action port [ 664.578681] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-633b2827-d754-4235-8781-d7f11d7de36b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.578887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-633b2827-d754-4235-8781-d7f11d7de36b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.578887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-633b2827-d754-4235-8781-d7f11d7de36b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.580819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-633b2827-d754-4235-8781-d7f11d7de36b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.580819] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('633b2827-d754-4235-8781-d7f11d7de36b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.634618] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.634618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.634618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.634618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.634618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.648090] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 in Status: IN_PROGRESS for 2s [ 664.730154] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.730154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.730369] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.731347] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.731456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.731787] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.731940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.732030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.732271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.732350] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.733310] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 597eb346-7afe-45b2-a812-9f2a8e62680f already deleted. [ 664.733459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.879557] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.879862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.879862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.880313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.880313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.881428] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b34086e-8eac-4499-9c02-2280b24b0698 is going to be created. [ 664.892689] env[70535]: INFO networking_nsxv3.common.synchronization [None req-bc867fd8-f8ff-4a2e-9aa8-7e827f0a849a None None] Enqueued Resource ID: cc718f49-93a6-4f0b-8726-1a601c8d5afb with Priority: HIGHEST for action port [ 664.892689] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc718f49-93a6-4f0b-8726-1a601c8d5afb with Priority: HIGHEST for action port [ 664.892878] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc718f49-93a6-4f0b-8726-1a601c8d5afb taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.893030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc718f49-93a6-4f0b-8726-1a601c8d5afb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.894093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc718f49-93a6-4f0b-8726-1a601c8d5afb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.894428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc718f49-93a6-4f0b-8726-1a601c8d5afb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.894522] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc718f49-93a6-4f0b-8726-1a601c8d5afb',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.909835] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.910462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.910462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.910462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.910462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.927082] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: UNINITIALIZED for 2s [ 664.989157] env[70535]: INFO networking_nsxv3.common.synchronization [None req-f2063d6f-8083-4c1d-ae69-ce5063ab624f tempest-ServersWithSpecificFlavorTestJSON-86157586 tempest-ServersWithSpecificFlavorTestJSON-86157586-project-member] Enqueued Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_rules [ 664.990783] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_rules [ 664.990783] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b3e2660-4c57-4d95-a486-449e2bf37488 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.990783] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.990783] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.990783] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.990783] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.084629] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 633b2827-d754-4235-8781-d7f11d7de36b [ 665.084629] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.084629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.084629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.084629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.084629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.084629] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:633b2827-d754-4235-8781-d7f11d7de36b already deleted. [ 665.084629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-633b2827-d754-4235-8781-d7f11d7de36b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.398315] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc718f49-93a6-4f0b-8726-1a601c8d5afb [ 665.400663] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.400663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.400663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.400663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.400663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.400663] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc718f49-93a6-4f0b-8726-1a601c8d5afb already deleted. [ 665.400663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc718f49-93a6-4f0b-8726-1a601c8d5afb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.487047] env[70535]: INFO networking_nsxv3.common.synchronization [None req-4f5e57be-4cbf-4270-a879-ad54cdba2500 tempest-ServersWithSpecificFlavorTestJSON-86157586 tempest-ServersWithSpecificFlavorTestJSON-86157586-project-member] Enqueued Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_rules [ 665.487661] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_rules [ 665.487952] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b3e2660-4c57-4d95-a486-449e2bf37488 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.489605] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.512144] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.512318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.512383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.512608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.512697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.512792] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 already deleted. [ 665.512917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.513126] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.514385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.514385] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.739255] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.739533] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.739684] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.740089] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.740518] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.740726] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.741104] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.741400] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.741756] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.742040] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.743369] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.743369] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.743369] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.743369] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.743369] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.743369] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.768427] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.770029] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 665.770029] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.770029] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.770029] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-d5bc6104-fa85-47df-bc0a-379b2419fd05 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.770029] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-d5bc6104-fa85-47df-bc0a-379b2419fd05" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.770744] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-d5bc6104-fa85-47df-bc0a-379b2419fd05" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.771367] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-d5bc6104-fa85-47df-bc0a-379b2419fd05" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.772335] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5bc6104-fa85-47df-bc0a-379b2419fd05',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.916029] env[70535]: INFO networking_nsxv3.common.synchronization [None req-a8f4c09c-5646-4386-a999-c7db32478a55 None None] Enqueued Resource ID: 55b3eea6-70d8-4464-b3f9-cc772c9c3dff with Priority: HIGHEST for action port [ 665.916289] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b3eea6-70d8-4464-b3f9-cc772c9c3dff with Priority: HIGHEST for action port [ 665.916843] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-55b3eea6-70d8-4464-b3f9-cc772c9c3dff taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.916965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55b3eea6-70d8-4464-b3f9-cc772c9c3dff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.917043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55b3eea6-70d8-4464-b3f9-cc772c9c3dff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.917350] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55b3eea6-70d8-4464-b3f9-cc772c9c3dff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.917438] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55b3eea6-70d8-4464-b3f9-cc772c9c3dff',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.040333] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.040558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.040657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.040846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.041048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.041048] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 already deleted. [ 666.041989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.246529] env[70535]: INFO networking_nsxv3.common.synchronization [req-6a3e456f-9e1a-40b3-a2dd-eeaa613581d8 req-117c0e6e-e800-4f31-af95-5ce407077aab tempest-ServerDiskConfigTestJSON-1021082095 tempest-ServerDiskConfigTestJSON-1021082095-project-member] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 666.247122] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 666.247434] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.247553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.248421] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.248421] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.248421] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.248695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.248695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.248799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.248834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.250630] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.278175] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.278175] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.278175] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.278175] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.278175] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.278175] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port d5bc6104-fa85-47df-bc0a-379b2419fd05 not found, creating... [ 666.278175] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.278175] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.278175] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.278175] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.278175] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.278706] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.278706] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.278706] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.278706] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.278706] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.279387] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: d5bc6104-fa85-47df-bc0a-379b2419fd05 is going to be created. [ 666.333381] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.333381] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.333381] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.333381] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.333381] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.333381] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-d5bc6104-fa85-47df-bc0a-379b2419fd05" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.421859] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55b3eea6-70d8-4464-b3f9-cc772c9c3dff [ 666.421859] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.421859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.421859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.421859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.421859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.421859] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55b3eea6-70d8-4464-b3f9-cc772c9c3dff already deleted. [ 666.421859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55b3eea6-70d8-4464-b3f9-cc772c9c3dff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.661375] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 in Status: SUCCESS [ 666.661375] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.685980] env[70535]: INFO networking_nsxv3.common.synchronization [req-cbdb4e59-45a3-460c-b1b9-6181dc944238 req-9db7297f-df33-4998-8d43-c68ee74ae187 service nova] Enqueued Resource ID: 81327d43-2c13-4e7b-b63b-d04a175b637e with Priority: HIGHEST for action security_group_rules [ 666.687098] env[70535]: INFO networking_nsxv3.common.synchronization [req-cbdb4e59-45a3-460c-b1b9-6181dc944238 req-9db7297f-df33-4998-8d43-c68ee74ae187 service nova] Enqueued Resource ID: 81327d43-2c13-4e7b-b63b-d04a175b637e with Priority: HIGHEST for action security_group_members [ 666.687921] env[70535]: INFO networking_nsxv3.common.synchronization [req-cbdb4e59-45a3-460c-b1b9-6181dc944238 req-9db7297f-df33-4998-8d43-c68ee74ae187 service nova] Enqueued Resource ID: 62810186-00c9-4f73-a5b5-e96c4ef94ad3 with Priority: HIGHEST for action port [ 666.690649] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81327d43-2c13-4e7b-b63b-d04a175b637e with Priority: HIGHEST for action security_group_rules [ 666.690649] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81327d43-2c13-4e7b-b63b-d04a175b637e with Priority: HIGHEST for action security_group_members [ 666.690649] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62810186-00c9-4f73-a5b5-e96c4ef94ad3 with Priority: HIGHEST for action port [ 666.690649] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81327d43-2c13-4e7b-b63b-d04a175b637e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.690649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.690649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.690649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.690649] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81327d43-2c13-4e7b-b63b-d04a175b637e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.692447] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-81327d43-2c13-4e7b-b63b-d04a175b637e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.692447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.692447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.692635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.692797] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.693245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.693423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.693580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.693714] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.693851] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81327d43-2c13-4e7b-b63b-d04a175b637e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.695409] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-62810186-00c9-4f73-a5b5-e96c4ef94ad3 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.696021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62810186-00c9-4f73-a5b5-e96c4ef94ad3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.696154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62810186-00c9-4f73-a5b5-e96c4ef94ad3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.696392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62810186-00c9-4f73-a5b5-e96c4ef94ad3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.696511] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62810186-00c9-4f73-a5b5-e96c4ef94ad3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.753948] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.753948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.753948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.753948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.753948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.753948] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.753948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.753948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.753948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.753948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.753948] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 already deleted. [ 666.753948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.942134] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: SUCCESS [ 666.942411] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.942685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.942766] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.942966] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.943127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.943217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.943381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.943433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.943521] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.943600] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.198811] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-81327d43-2c13-4e7b-b63b-d04a175b637e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.198811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.198935] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81327d43-2c13-4e7b-b63b-d04a175b637e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.203573] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62810186-00c9-4f73-a5b5-e96c4ef94ad3 with status ACTIVE [ 667.204384] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.204384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.204384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.204561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.204561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.204943] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.204943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.204943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.205104] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.205221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.205478] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.205627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.205694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.205848] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.205934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.206077] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62810186-00c9-4f73-a5b5-e96c4ef94ad3 is going to be updated. [ 667.240031] env[70535]: INFO networking_nsxv3.common.synchronization [None req-5afd9e06-cd21-4e11-bc16-007e0ace542f tempest-VolumesAssistedSnapshotsTest-117852516 tempest-VolumesAssistedSnapshotsTest-117852516-project-member] Enqueued Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGHEST for action security_group_rules [ 667.243777] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.243777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.244017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.244500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.244500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.244500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62810186-00c9-4f73-a5b5-e96c4ef94ad3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.245205] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGHEST for action security_group_rules [ 667.245292] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.245434] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.245465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.245673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.245841] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90c4bd0b-6551-40c3-9e23-945c4ab91af0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.446503] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.446698] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.446742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.446917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.447113] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.447334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.447334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.447444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.447576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.447615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.447743] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.447835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.447893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.448046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.448321] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.448321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.448321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.448477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.448527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.448611] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.448699] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.604277] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.604277] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.604385] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.604927] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.605394] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.605719] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.605798] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.606279] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.606279] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.607024] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.607024] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.607024] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.607024] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.607266] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.607266] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.607359] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.633038] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.633257] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 667.633401] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.633597] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.634075] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-c3bff03f-a6d6-4943-a506-4df749de6e43 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.634187] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-c3bff03f-a6d6-4943-a506-4df749de6e43" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.634441] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-c3bff03f-a6d6-4943-a506-4df749de6e43" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.634647] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-c3bff03f-a6d6-4943-a506-4df749de6e43" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.634796] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3bff03f-a6d6-4943-a506-4df749de6e43',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.660316] env[70535]: INFO networking_nsxv3.common.synchronization [None req-c6d7fdea-4218-45b2-b144-1737c608aa04 tempest-VolumesAssistedSnapshotsTest-117852516 tempest-VolumesAssistedSnapshotsTest-117852516-project-member] Enqueued Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGHEST for action security_group_rules [ 667.660759] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGHEST for action security_group_rules [ 667.661353] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.661475] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.705080] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81327d43-2c13-4e7b-b63b-d04a175b637e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.771835] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.771978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.772092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.773338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.773338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.773338] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 already deleted. [ 667.773338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.773338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.773338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.773338] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90c4bd0b-6551-40c3-9e23-945c4ab91af0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.951809] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b34086e-8eac-4499-9c02-2280b24b0698: rpc.has_security_group_logging(os_id): False [ 667.972697] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.972697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.972918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.972989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.973093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.973279] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.973377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.973438] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.973592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.973686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.973838] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.973928] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.973993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.974178] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.974225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.974496] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.974569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.974609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.974754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.974824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.974923] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b34086e-8eac-4499-9c02-2280b24b0698 is going to be created. [ 668.045179] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.045458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.045458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.045736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.045946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.058772] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: IN_PROGRESS for 2s [ 668.139870] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.139870] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.139870] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.139870] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.140761] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.140761] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port c3bff03f-a6d6-4943-a506-4df749de6e43 not found, creating... [ 668.140882] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.141238] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.141238] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.141471] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.141731] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.142645] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.143137] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.143215] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.143606] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.143861] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.144110] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: c3bff03f-a6d6-4943-a506-4df749de6e43 is going to be created. [ 668.185871] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.186079] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.186079] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.186402] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.186638] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.186859] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-c3bff03f-a6d6-4943-a506-4df749de6e43" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.208135] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.208135] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.208465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.208527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.208669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.208831] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81327d43-2c13-4e7b-b63b-d04a175b637e is going to be created. [ 668.242031] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.242248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.242248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.242754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.242754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.255469] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81327d43-2c13-4e7b-b63b-d04a175b637e in Status: UNINITIALIZED for 2s [ 668.306135] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.306360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.306360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.306594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.306695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.306810] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 already deleted. [ 668.306896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.490979] env[70535]: INFO networking_nsxv3.common.synchronization [None req-4eefc378-921c-4bc8-b090-94547e10160d None None] Enqueued Resource ID: 43a3de88-d1fe-40dc-ba02-d59fd85a8279 with Priority: HIGHEST for action port [ 668.491463] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a3de88-d1fe-40dc-ba02-d59fd85a8279 with Priority: HIGHEST for action port [ 668.491777] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-43a3de88-d1fe-40dc-ba02-d59fd85a8279 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.491910] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43a3de88-d1fe-40dc-ba02-d59fd85a8279" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.491973] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43a3de88-d1fe-40dc-ba02-d59fd85a8279" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.493996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43a3de88-d1fe-40dc-ba02-d59fd85a8279" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.494116] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43a3de88-d1fe-40dc-ba02-d59fd85a8279',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.512537] env[70535]: INFO networking_nsxv3.common.synchronization [req-dfb6cdd4-9773-4686-a6f9-e6a39bb9576a req-84f52236-4983-4b6b-81ff-e735029ea65c service nova] Enqueued Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_rules [ 668.512537] env[70535]: INFO networking_nsxv3.common.synchronization [req-dfb6cdd4-9773-4686-a6f9-e6a39bb9576a req-84f52236-4983-4b6b-81ff-e735029ea65c service nova] Enqueued Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_members [ 668.512537] env[70535]: INFO networking_nsxv3.common.synchronization [req-dfb6cdd4-9773-4686-a6f9-e6a39bb9576a req-84f52236-4983-4b6b-81ff-e735029ea65c service nova] Enqueued Resource ID: d5bc6104-fa85-47df-bc0a-379b2419fd05 with Priority: HIGHEST for action port [ 668.512537] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_rules [ 668.512537] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_members [ 668.512537] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5bc6104-fa85-47df-bc0a-379b2419fd05 with Priority: HIGHEST for action port [ 668.514181] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-597eb346-7afe-45b2-a812-9f2a8e62680f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.514267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.514325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.514538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.514629] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.521090] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-597eb346-7afe-45b2-a812-9f2a8e62680f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.521090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.521090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.521090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.521090] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.521090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.521090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.521090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.521090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.521090] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.521554] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5bc6104-fa85-47df-bc0a-379b2419fd05 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.521554] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5bc6104-fa85-47df-bc0a-379b2419fd05" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.521554] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5bc6104-fa85-47df-bc0a-379b2419fd05" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.521749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5bc6104-fa85-47df-bc0a-379b2419fd05" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.521793] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5bc6104-fa85-47df-bc0a-379b2419fd05',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.996682] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43a3de88-d1fe-40dc-ba02-d59fd85a8279 [ 668.997158] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.997158] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.997158] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.997332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.997423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.997522] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43a3de88-d1fe-40dc-ba02-d59fd85a8279 already deleted. [ 668.997607] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43a3de88-d1fe-40dc-ba02-d59fd85a8279" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.026099] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-597eb346-7afe-45b2-a812-9f2a8e62680f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.026099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.026099] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.026856] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5bc6104-fa85-47df-bc0a-379b2419fd05 with status ACTIVE [ 669.026856] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.026856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.027051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.027807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.027807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.027807] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.027807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.027807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.027807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.027807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.028439] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.028439] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.028439] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.028439] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.028439] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.028439] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5bc6104-fa85-47df-bc0a-379b2419fd05 is going to be updated. [ 669.062972] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.062972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.062972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.062972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.062972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.063390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5bc6104-fa85-47df-bc0a-379b2419fd05" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.122453] env[70535]: INFO networking_nsxv3.common.synchronization [None req-796ba4e1-8c41-438d-812a-37238c5f4803 None None] Enqueued Resource ID: 42b2ca45-f077-46d9-abee-625c6e76a0e7 with Priority: HIGHEST for action port [ 669.124401] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42b2ca45-f077-46d9-abee-625c6e76a0e7 with Priority: HIGHEST for action port [ 669.125227] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-42b2ca45-f077-46d9-abee-625c6e76a0e7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.125606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42b2ca45-f077-46d9-abee-625c6e76a0e7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.127081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42b2ca45-f077-46d9-abee-625c6e76a0e7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.127081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42b2ca45-f077-46d9-abee-625c6e76a0e7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.127081] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42b2ca45-f077-46d9-abee-625c6e76a0e7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.531174] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.630360] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42b2ca45-f077-46d9-abee-625c6e76a0e7 [ 669.630859] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.630859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.630859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.631577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.631577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.631577] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42b2ca45-f077-46d9-abee-625c6e76a0e7 already deleted. [ 669.631577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42b2ca45-f077-46d9-abee-625c6e76a0e7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.972459] env[70535]: INFO networking_nsxv3.common.synchronization [req-df840753-7291-48f3-907d-3def96a5b6a6 req-6f6fa132-594c-45e9-bf93-d500b13ee2fe tempest-ServerDiagnosticsNegativeTest-84406442 tempest-ServerDiagnosticsNegativeTest-84406442-project-member] Enqueued Resource ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb with Priority: HIGHEST for action security_group_members [ 669.972459] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb with Priority: HIGHEST for action security_group_members [ 669.972459] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1dcacf3-cf94-4660-82d4-dac926fd56fb taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.972459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.972459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.973519] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.973780] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.975875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.975875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.975875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.975875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.975875] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1dcacf3-cf94-4660-82d4-dac926fd56fb',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.035165] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.035165] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.035491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.035491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.035776] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.035866] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 597eb346-7afe-45b2-a812-9f2a8e62680f is going to be created. [ 670.062407] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.062813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.062813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.062813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.062998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.079034] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 597eb346-7afe-45b2-a812-9f2a8e62680f in Status: UNINITIALIZED for 2s [ 670.079034] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: SUCCESS [ 670.079034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.268060] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81327d43-2c13-4e7b-b63b-d04a175b637e in Status: SUCCESS [ 670.269377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.269815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.270358] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.271041] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.271368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.271368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.271505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.271625] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.272348] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.272348] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81327d43-2c13-4e7b-b63b-d04a175b637e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.342124] env[70535]: INFO networking_nsxv3.common.synchronization [req-6a3e456f-9e1a-40b3-a2dd-eeaa613581d8 req-034dbc28-470f-4f09-9fa4-a50edf1f6c00 service nova] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_rules [ 670.342124] env[70535]: INFO networking_nsxv3.common.synchronization [req-6a3e456f-9e1a-40b3-a2dd-eeaa613581d8 req-034dbc28-470f-4f09-9fa4-a50edf1f6c00 service nova] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 670.342425] env[70535]: INFO networking_nsxv3.common.synchronization [req-6a3e456f-9e1a-40b3-a2dd-eeaa613581d8 req-034dbc28-470f-4f09-9fa4-a50edf1f6c00 service nova] Enqueued Resource ID: c3bff03f-a6d6-4943-a506-4df749de6e43 with Priority: HIGHEST for action port [ 670.343449] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_rules [ 670.343784] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 670.344236] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3bff03f-a6d6-4943-a506-4df749de6e43 with Priority: HIGHEST for action port [ 670.345099] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.351033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.351033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.351033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.351033] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.351033] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.351033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.351033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.355015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.355015] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.355015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.355015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.355015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.355015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.355015] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.355015] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3bff03f-a6d6-4943-a506-4df749de6e43 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.355015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3bff03f-a6d6-4943-a506-4df749de6e43" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.355015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3bff03f-a6d6-4943-a506-4df749de6e43" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.355015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3bff03f-a6d6-4943-a506-4df749de6e43" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.355015] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3bff03f-a6d6-4943-a506-4df749de6e43',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.477783] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.477906] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.478372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.479633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.479633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.479633] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.479633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.479633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.479807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.479871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.480071] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb already deleted. [ 670.480238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.775506] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-81327d43-2c13-4e7b-b63b-d04a175b637e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.775656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.775745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.775934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.776112] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.776235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.778106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.778106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.778106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.778106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.778106] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-81327d43-2c13-4e7b-b63b-d04a175b637e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.778106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.778106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.778106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.778106] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.778106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.778106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.778106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.778106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.778106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.778106] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81327d43-2c13-4e7b-b63b-d04a175b637e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.856630] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.860518] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.860518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.860518] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3bff03f-a6d6-4943-a506-4df749de6e43 with status ACTIVE [ 670.860518] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.860518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.860518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.860518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.860518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.860518] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.860518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.861336] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.861581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.861674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.863031] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.863216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.863299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.863494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.863581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.863677] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3bff03f-a6d6-4943-a506-4df749de6e43 is going to be updated. [ 670.887050] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.887993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.887993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.887993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.888211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.888461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3bff03f-a6d6-4943-a506-4df749de6e43" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.280882] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81327d43-2c13-4e7b-b63b-d04a175b637e: rpc.has_security_group_logging(os_id): False [ 671.309192] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.309192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.309192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.309192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.309192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.309192] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.309192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.309192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.309192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.309192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.309192] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.309192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.309192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.309192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.309192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.310642] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.310803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.311020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.311161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.311526] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.311526] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81327d43-2c13-4e7b-b63b-d04a175b637e is going to be created. [ 671.366285] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.389840] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.390057] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.391747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.391747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.391747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.412484] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81327d43-2c13-4e7b-b63b-d04a175b637e in Status: IN_PROGRESS for 2s [ 671.741347] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.741347] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.741347] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.741347] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.741911] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.742437] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.742841] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.743298] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.744022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.744494] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.744707] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.744955] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.746409] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.746409] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.746409] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.746409] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.767695] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.767932] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 671.768019] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.768281] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.768716] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-18d4a887-80cf-4212-9a68-56101524e4fe taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.769790] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-18d4a887-80cf-4212-9a68-56101524e4fe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.769974] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-18d4a887-80cf-4212-9a68-56101524e4fe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.770464] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-18d4a887-80cf-4212-9a68-56101524e4fe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.770750] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18d4a887-80cf-4212-9a68-56101524e4fe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.871591] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.871591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.871591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.871591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.871591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.871591] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be created. [ 671.900981] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.901301] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.901406] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.901646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.901839] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.914465] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: UNINITIALIZED for 2s [ 671.939336] env[70535]: INFO networking_nsxv3.common.synchronization [None req-bd530aa1-511b-4a5b-a13e-a16f5d2832e5 None None] Enqueued Resource ID: d5bb2656-68a3-4ad8-ad62-db5ce4f70721 with Priority: HIGHEST for action port [ 671.939454] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5bb2656-68a3-4ad8-ad62-db5ce4f70721 with Priority: HIGHEST for action port [ 671.941471] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5bb2656-68a3-4ad8-ad62-db5ce4f70721 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.941629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5bb2656-68a3-4ad8-ad62-db5ce4f70721" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.941701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5bb2656-68a3-4ad8-ad62-db5ce4f70721" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.942332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5bb2656-68a3-4ad8-ad62-db5ce4f70721" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.943387] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5bb2656-68a3-4ad8-ad62-db5ce4f70721',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.092028] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 597eb346-7afe-45b2-a812-9f2a8e62680f in Status: SUCCESS [ 672.092028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.092957] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.092957] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.092957] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.092957] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.092957] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.092957] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.094052] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.094052] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.094052] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.266356] env[70535]: INFO networking_nsxv3.common.synchronization [req-259b9778-0a28-41a5-8a7e-090dc365fe0f req-584459bf-0e1a-498d-a075-39291a624667 tempest-DeleteServersAdminTestJSON-1501775615 tempest-DeleteServersAdminTestJSON-1501775615-project-admin] Enqueued Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_members [ 672.268051] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_members [ 672.268904] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.269365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.269443] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.271377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.271454] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.271766] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.272787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.273070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.273179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.273326] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.274999] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.275220] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.275350] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.275604] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.277779] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.277779] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 18d4a887-80cf-4212-9a68-56101524e4fe not found, creating... [ 672.277779] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.278010] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.278065] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.278416] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.278545] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.282600] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.282600] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.283229] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.283229] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.283229] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.283406] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 18d4a887-80cf-4212-9a68-56101524e4fe is going to be created. [ 672.314055] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.314902] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.314902] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.314902] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.315158] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.315495] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-18d4a887-80cf-4212-9a68-56101524e4fe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.449167] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5bb2656-68a3-4ad8-ad62-db5ce4f70721 [ 672.449327] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.449505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.449505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.449717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.449965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.449965] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5bb2656-68a3-4ad8-ad62-db5ce4f70721 already deleted. [ 672.449965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5bb2656-68a3-4ad8-ad62-db5ce4f70721" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.596337] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.617217] env[70535]: INFO networking_nsxv3.common.synchronization [None req-6af55a55-c5d9-41f1-9a58-8b1f160d873c None None] Enqueued Resource ID: fd1ad148-a022-46ba-ba96-6a0606fa0a24 with Priority: HIGHEST for action port [ 672.618076] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1ad148-a022-46ba-ba96-6a0606fa0a24 with Priority: HIGHEST for action port [ 672.619715] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd1ad148-a022-46ba-ba96-6a0606fa0a24 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.619715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd1ad148-a022-46ba-ba96-6a0606fa0a24" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.619715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd1ad148-a022-46ba-ba96-6a0606fa0a24" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.619890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd1ad148-a022-46ba-ba96-6a0606fa0a24" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.619924] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd1ad148-a022-46ba-ba96-6a0606fa0a24',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.786218] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.786582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.786582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.786700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.786735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.787172] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.787287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.787344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.787536] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.787623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.787713] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 is going to be updated. [ 672.836076] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.836288] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.836372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.837189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.837189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.848024] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 in Status: IN_PROGRESS for 2s [ 673.099569] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 597eb346-7afe-45b2-a812-9f2a8e62680f: rpc.has_security_group_logging(os_id): False [ 673.119449] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.119929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.120352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.120938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.120938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.121088] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.122134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.122134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.122134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.122134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.122134] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 597eb346-7afe-45b2-a812-9f2a8e62680f is going to be created. [ 673.125096] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd1ad148-a022-46ba-ba96-6a0606fa0a24 [ 673.125096] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.125096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.125096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.125096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.125096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.125096] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd1ad148-a022-46ba-ba96-6a0606fa0a24 already deleted. [ 673.125096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd1ad148-a022-46ba-ba96-6a0606fa0a24" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.203554] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.203554] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.203554] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.203554] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.203825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.216934] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 597eb346-7afe-45b2-a812-9f2a8e62680f in Status: IN_PROGRESS for 2s [ 673.428708] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81327d43-2c13-4e7b-b63b-d04a175b637e in Status: SUCCESS [ 673.429147] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.897952] env[70535]: INFO networking_nsxv3.common.synchronization [None req-0db14ce6-ccdc-4df2-9c3e-8b2060352de3 None None] Enqueued Resource ID: e505073d-fe87-478c-8ed5-459781b06c30 with Priority: HIGHEST for action port [ 673.897952] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e505073d-fe87-478c-8ed5-459781b06c30 with Priority: HIGHEST for action port [ 673.898173] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-e505073d-fe87-478c-8ed5-459781b06c30 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.898287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e505073d-fe87-478c-8ed5-459781b06c30" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.898354] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e505073d-fe87-478c-8ed5-459781b06c30" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.898981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e505073d-fe87-478c-8ed5-459781b06c30" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.898981] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e505073d-fe87-478c-8ed5-459781b06c30',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.927685] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 673.927685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.927685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.927685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.927685] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.927685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.927685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.927685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.927685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.927685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.927685] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.080835] env[70535]: INFO networking_nsxv3.common.synchronization [req-611dcbce-0843-458c-ae11-19a34c61ce00 req-feccb8e6-9992-4892-9c45-e49d75a9f12c tempest-ImagesTestJSON-1564979202 tempest-ImagesTestJSON-1564979202-project-member] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 674.081894] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 674.082779] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.082779] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.082779] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.083226] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.083362] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.083570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.083790] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.083899] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.084144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.086616] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.240146] env[70535]: INFO networking_nsxv3.common.synchronization [req-df840753-7291-48f3-907d-3def96a5b6a6 req-e72696e8-a79d-40e0-ba7b-4feb0f602875 service nova] Enqueued Resource ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb with Priority: HIGHEST for action security_group_rules [ 674.240342] env[70535]: INFO networking_nsxv3.common.synchronization [req-df840753-7291-48f3-907d-3def96a5b6a6 req-e72696e8-a79d-40e0-ba7b-4feb0f602875 service nova] Enqueued Resource ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb with Priority: HIGHEST for action security_group_members [ 674.241041] env[70535]: INFO networking_nsxv3.common.synchronization [req-df840753-7291-48f3-907d-3def96a5b6a6 req-e72696e8-a79d-40e0-ba7b-4feb0f602875 service nova] Enqueued Resource ID: 18d4a887-80cf-4212-9a68-56101524e4fe with Priority: HIGHEST for action port [ 674.241041] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb with Priority: HIGHEST for action security_group_rules [ 674.241041] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb with Priority: HIGHEST for action security_group_members [ 674.241041] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18d4a887-80cf-4212-9a68-56101524e4fe with Priority: HIGHEST for action port [ 674.241586] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1dcacf3-cf94-4660-82d4-dac926fd56fb taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.241739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.241787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.245091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.245091] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1dcacf3-cf94-4660-82d4-dac926fd56fb',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.245091] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1dcacf3-cf94-4660-82d4-dac926fd56fb taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.245091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.245091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.245091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.245091] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.245091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.245796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.245796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.245796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.245796] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1dcacf3-cf94-4660-82d4-dac926fd56fb',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.247387] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-18d4a887-80cf-4212-9a68-56101524e4fe taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.247521] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18d4a887-80cf-4212-9a68-56101524e4fe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.247683] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18d4a887-80cf-4212-9a68-56101524e4fe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.247763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18d4a887-80cf-4212-9a68-56101524e4fe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.247845] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18d4a887-80cf-4212-9a68-56101524e4fe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.402359] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e505073d-fe87-478c-8ed5-459781b06c30 [ 674.402875] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.402875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.402875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.403153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.403153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.403343] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e505073d-fe87-478c-8ed5-459781b06c30 already deleted. [ 674.403343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e505073d-fe87-478c-8ed5-459781b06c30" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.431636] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.431636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.431636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.432028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.432028] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.432028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.432028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.432410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.432410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.432410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.432508] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.432591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.433174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.433174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.433252] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.433342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.433414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.433563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.433644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.433730] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.433821] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.567077] env[70535]: INFO networking_nsxv3.common.synchronization [None req-16887583-0357-4e18-9921-9b0538020fcb None None] Enqueued Resource ID: 8cf67325-fd03-4755-9cfb-1361671eaaa6 with Priority: HIGHEST for action port [ 674.567904] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cf67325-fd03-4755-9cfb-1361671eaaa6 with Priority: HIGHEST for action port [ 674.568120] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cf67325-fd03-4755-9cfb-1361671eaaa6 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.569984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cf67325-fd03-4755-9cfb-1361671eaaa6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.569984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cf67325-fd03-4755-9cfb-1361671eaaa6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.569984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cf67325-fd03-4755-9cfb-1361671eaaa6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.569984] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cf67325-fd03-4755-9cfb-1361671eaaa6',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.587631] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.587631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.587631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.587631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.587881] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.587881] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.588125] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.588125] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.590318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.590318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.590318] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e already deleted. [ 674.590318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.754019] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1dcacf3-cf94-4660-82d4-dac926fd56fb taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.754019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.754019] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1dcacf3-cf94-4660-82d4-dac926fd56fb',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.755590] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18d4a887-80cf-4212-9a68-56101524e4fe with status ACTIVE [ 674.755778] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.755897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.755959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.756200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.756284] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.756634] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.756798] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.756895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.757137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.757268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.757523] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.757670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.757767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.757878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.757954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.758045] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18d4a887-80cf-4212-9a68-56101524e4fe is going to be updated. [ 674.781385] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.781385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.781385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.781599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.781635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.781796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18d4a887-80cf-4212-9a68-56101524e4fe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.868870] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 in Status: SUCCESS [ 674.869082] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 deletion is rescheduled due to dependency. [ 674.869215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.937501] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for acf72aac-3e82-4909-b3c4-dccd81be0846: rpc.has_security_group_logging(os_id): False [ 674.963370] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.963370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.963370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.963370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.963370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.963370] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.963370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.963370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.963370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.963370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.963370] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.963370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.963370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.963370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.963370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.964055] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.964055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.964055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.964055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.964055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.964055] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be created. [ 675.038642] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.038934] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.039023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.039430] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.039647] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.039811] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.039927] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.040440] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.040593] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.041344] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.041475] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.041658] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.041714] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.041811] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.041915] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.042059] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.061369] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.061509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.061626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.061816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.061989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.067441] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.067441] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 675.067441] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.067441] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.067441] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-3b7a93fc-7e52-4a43-8ebb-5cda7be152ff taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.067441] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-3b7a93fc-7e52-4a43-8ebb-5cda7be152ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.067886] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-3b7a93fc-7e52-4a43-8ebb-5cda7be152ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.067886] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-3b7a93fc-7e52-4a43-8ebb-5cda7be152ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.068040] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b7a93fc-7e52-4a43-8ebb-5cda7be152ff',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.073017] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cf67325-fd03-4755-9cfb-1361671eaaa6 [ 675.073017] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.073017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.073017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.073017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.073017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.073017] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cf67325-fd03-4755-9cfb-1361671eaaa6 already deleted. [ 675.073017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cf67325-fd03-4755-9cfb-1361671eaaa6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.076305] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 675.228949] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 597eb346-7afe-45b2-a812-9f2a8e62680f in Status: SUCCESS [ 675.229204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.263575] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1dcacf3-cf94-4660-82d4-dac926fd56fb',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.401706] env[70535]: INFO networking_nsxv3.common.synchronization [None req-ae918e33-9edb-4daf-9568-ffa8d34e0215 None None] Enqueued Resource ID: 393ac962-a40f-4254-8eb4-069f9aa52321 with Priority: HIGHEST for action port [ 675.404337] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393ac962-a40f-4254-8eb4-069f9aa52321 with Priority: HIGHEST for action port [ 675.405567] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-393ac962-a40f-4254-8eb4-069f9aa52321 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.405567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-393ac962-a40f-4254-8eb4-069f9aa52321" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.405567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-393ac962-a40f-4254-8eb4-069f9aa52321" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.405567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-393ac962-a40f-4254-8eb4-069f9aa52321" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.405567] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('393ac962-a40f-4254-8eb4-069f9aa52321',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.570180] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.570676] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.570774] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.571350] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.571350] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.571576] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 3b7a93fc-7e52-4a43-8ebb-5cda7be152ff not found, creating... [ 675.571904] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.572131] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.572292] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.572792] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.572908] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.573266] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.573439] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.573556] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.573786] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.573924] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.574097] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 3b7a93fc-7e52-4a43-8ebb-5cda7be152ff is going to be created. [ 675.596267] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.596486] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.596612] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.596887] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.597126] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.597403] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-3b7a93fc-7e52-4a43-8ebb-5cda7be152ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.765093] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.765379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.766479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.766479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.766479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.766479] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb is going to be created. [ 675.799565] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.799764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.799810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.800887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.800887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.813996] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb in Status: UNINITIALIZED for 2s [ 675.910137] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 393ac962-a40f-4254-8eb4-069f9aa52321 [ 675.910137] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.910137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.910137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.910137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.910137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.910137] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:393ac962-a40f-4254-8eb4-069f9aa52321 already deleted. [ 675.910137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-393ac962-a40f-4254-8eb4-069f9aa52321" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.521762] env[70535]: INFO networking_nsxv3.common.synchronization [None req-cce8adf0-388b-41df-ad24-3af74d6db427 None None] Enqueued Resource ID: 6ef7fd01-9402-40dc-9501-8ba27d496cd4 with Priority: HIGHEST for action port [ 676.521762] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ef7fd01-9402-40dc-9501-8ba27d496cd4 with Priority: HIGHEST for action port [ 676.521762] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ef7fd01-9402-40dc-9501-8ba27d496cd4 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.522452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ef7fd01-9402-40dc-9501-8ba27d496cd4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.522753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ef7fd01-9402-40dc-9501-8ba27d496cd4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.523164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ef7fd01-9402-40dc-9501-8ba27d496cd4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.523598] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ef7fd01-9402-40dc-9501-8ba27d496cd4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.922853] env[70535]: INFO networking_nsxv3.common.synchronization [req-1121cbf8-9484-48fd-a608-c990af147e58 req-a0e87936-f8c9-47e6-8556-61811b2cd721 tempest-ImagesNegativeTestJSON-1062958869 tempest-ImagesNegativeTestJSON-1062958869-project-member] Enqueued Resource ID: 5c0519b9-5948-4844-8e1d-20705cb47261 with Priority: HIGHEST for action security_group_members [ 676.928951] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c0519b9-5948-4844-8e1d-20705cb47261 with Priority: HIGHEST for action security_group_members [ 676.928951] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c0519b9-5948-4844-8e1d-20705cb47261 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.928951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.928951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.928951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.928951] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.928951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.928951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.928951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.928951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.928951] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c0519b9-5948-4844-8e1d-20705cb47261',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.930368] env[70535]: INFO networking_nsxv3.common.synchronization [None req-c5f6da4e-4e0f-4bbe-a754-5234b999586c None None] Enqueued Resource ID: 93b1f903-664f-46c6-9cc0-bd3e7ba1acf9 with Priority: HIGHEST for action port [ 676.930807] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93b1f903-664f-46c6-9cc0-bd3e7ba1acf9 with Priority: HIGHEST for action port [ 676.931266] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-93b1f903-664f-46c6-9cc0-bd3e7ba1acf9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.931266] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93b1f903-664f-46c6-9cc0-bd3e7ba1acf9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.931677] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93b1f903-664f-46c6-9cc0-bd3e7ba1acf9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.931677] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93b1f903-664f-46c6-9cc0-bd3e7ba1acf9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.931677] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93b1f903-664f-46c6-9cc0-bd3e7ba1acf9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.026844] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ef7fd01-9402-40dc-9501-8ba27d496cd4 [ 677.026942] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.027191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.027191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.028046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.028201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.028357] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ef7fd01-9402-40dc-9501-8ba27d496cd4 already deleted. [ 677.028357] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ef7fd01-9402-40dc-9501-8ba27d496cd4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.093181] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 677.093444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.431613] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.434880] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.435068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.435377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.435485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.435721] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.435838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.435903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.437020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.437020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.437020] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c0519b9-5948-4844-8e1d-20705cb47261 already deleted. [ 677.437020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.437020] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93b1f903-664f-46c6-9cc0-bd3e7ba1acf9 [ 677.437020] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.437020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.437020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.437020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.437408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.437408] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93b1f903-664f-46c6-9cc0-bd3e7ba1acf9 already deleted. [ 677.437408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93b1f903-664f-46c6-9cc0-bd3e7ba1acf9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.826040] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb in Status: SUCCESS [ 677.828019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.828019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.828019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.828019] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.828019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.828019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.828019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.828019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.828019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.828019] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1dcacf3-cf94-4660-82d4-dac926fd56fb',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.957981] env[70535]: INFO networking_nsxv3.common.synchronization [None req-69e4eae4-9892-4243-a9aa-4213cc318af0 tempest-ServerActionsTestJSON-1674828100 tempest-ServerActionsTestJSON-1674828100-project-member] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_rules [ 677.957981] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_rules [ 677.958501] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.958501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.958641] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.959533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.959533] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.082353] env[70535]: INFO networking_nsxv3.common.synchronization [req-611dcbce-0843-458c-ae11-19a34c61ce00 req-021fa93b-4030-4d9c-9d9b-2dcdd4b35e40 service nova] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_rules [ 678.082353] env[70535]: INFO networking_nsxv3.common.synchronization [req-611dcbce-0843-458c-ae11-19a34c61ce00 req-021fa93b-4030-4d9c-9d9b-2dcdd4b35e40 service nova] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 678.082353] env[70535]: INFO networking_nsxv3.common.synchronization [req-611dcbce-0843-458c-ae11-19a34c61ce00 req-021fa93b-4030-4d9c-9d9b-2dcdd4b35e40 service nova] Enqueued Resource ID: 3b7a93fc-7e52-4a43-8ebb-5cda7be152ff with Priority: HIGHEST for action port [ 678.082706] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_rules [ 678.082919] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 678.083084] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7a93fc-7e52-4a43-8ebb-5cda7be152ff with Priority: HIGHEST for action port [ 678.084679] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.085548] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.085637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.085982] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.086110] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.087639] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.091034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.091034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.091034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.091034] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.091034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.091034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.091034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.091034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.091034] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.091381] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b7a93fc-7e52-4a43-8ebb-5cda7be152ff taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.091381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b7a93fc-7e52-4a43-8ebb-5cda7be152ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.091478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b7a93fc-7e52-4a43-8ebb-5cda7be152ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.091681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b7a93fc-7e52-4a43-8ebb-5cda7be152ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.091800] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b7a93fc-7e52-4a43-8ebb-5cda7be152ff',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.236990] env[70535]: INFO networking_nsxv3.common.synchronization [None req-f16fca07-db6b-4aa1-9b56-8eaf2f03d602 tempest-ServerActionsTestJSON-1674828100 tempest-ServerActionsTestJSON-1674828100-project-member] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_rules [ 678.237944] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_rules [ 678.238754] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.238874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.331473] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1dcacf3-cf94-4660-82d4-dac926fd56fb taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.331473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.331473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.331473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.331473] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.331719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.331719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.331719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.331806] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.331884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.332037] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1dcacf3-cf94-4660-82d4-dac926fd56fb taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.332139] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.332204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.332339] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.332475] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.332572] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.332622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.332769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.332850] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.332932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.333060] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1dcacf3-cf94-4660-82d4-dac926fd56fb',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.487444] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.487800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.487800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.487929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.487960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.488052] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 already deleted. [ 678.488215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.488310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.488464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.488548] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.502629] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.503012] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-243" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.503012] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-243" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.503432] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-243" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.503730] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.503901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.504085] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.504341] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.504493] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.504744] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.505123] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.505308] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.505522] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.505707] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.505837] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.505984] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.528342] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.528342] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 678.528617] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.528650] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-243" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.528991] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-3c12d569-659e-442c-a3b2-b297fa1a48a1 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.529657] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-3c12d569-659e-442c-a3b2-b297fa1a48a1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.530232] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-3c12d569-659e-442c-a3b2-b297fa1a48a1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.530667] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-3c12d569-659e-442c-a3b2-b297fa1a48a1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.530958] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c12d569-659e-442c-a3b2-b297fa1a48a1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.596523] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b7a93fc-7e52-4a43-8ebb-5cda7be152ff with status ACTIVE [ 678.596657] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.596800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.596893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.599696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.599696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.599696] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.599696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.599696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.599696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.599696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.599696] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.599696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.599696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.599696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.599696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.599696] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b7a93fc-7e52-4a43-8ebb-5cda7be152ff is going to be updated. [ 678.599696] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.605062] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.605265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.632345] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.633133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.633268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.633508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.633664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.633839] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b7a93fc-7e52-4a43-8ebb-5cda7be152ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.836727] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1dcacf3-cf94-4660-82d4-dac926fd56fb: rpc.has_security_group_logging(os_id): False [ 678.855861] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.856194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.856784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.856784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.856784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.856914] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.856969] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.857158] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.857348] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.857348] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.860837] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.860837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.860837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.860837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.860837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.860837] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.860837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.860837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.860837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.860837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.860837] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb is going to be created. [ 678.862447] env[70535]: INFO networking_nsxv3.common.synchronization [None req-d66472bf-9d99-4513-9851-077be7c65d18 None None] Enqueued Resource ID: 80ef938a-a7c9-4e4d-ad0e-bc258f6ec181 with Priority: HIGHEST for action port [ 678.863209] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80ef938a-a7c9-4e4d-ad0e-bc258f6ec181 with Priority: HIGHEST for action port [ 678.863590] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-80ef938a-a7c9-4e4d-ad0e-bc258f6ec181 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.863746] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80ef938a-a7c9-4e4d-ad0e-bc258f6ec181" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.863833] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80ef938a-a7c9-4e4d-ad0e-bc258f6ec181" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.864129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80ef938a-a7c9-4e4d-ad0e-bc258f6ec181" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.864292] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80ef938a-a7c9-4e4d-ad0e-bc258f6ec181',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.924527] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.924527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.924527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.924527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.924527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.937663] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb in Status: IN_PROGRESS for 2s [ 679.031435] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.031758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.031758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.031934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.032039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.032194] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 already deleted. [ 679.032287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.035550] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.035550] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.035550] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.035550] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.035550] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.035550] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 3c12d569-659e-442c-a3b2-b297fa1a48a1 not found, creating... [ 679.035788] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.035929] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.036023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.036252] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.036394] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.037214] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.037214] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.037516] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.037770] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.037930] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.038092] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 3c12d569-659e-442c-a3b2-b297fa1a48a1 is going to be created. [ 679.041326] env[70535]: INFO networking_nsxv3.common.synchronization [None req-26d8a806-34ba-4915-9416-53def8920b5b None None] Enqueued Resource ID: 6937094d-194b-4e80-a45b-81ddf1df0662 with Priority: HIGHEST for action port [ 679.042068] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6937094d-194b-4e80-a45b-81ddf1df0662 with Priority: HIGHEST for action port [ 679.043337] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-6937094d-194b-4e80-a45b-81ddf1df0662 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.043464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6937094d-194b-4e80-a45b-81ddf1df0662" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.043506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6937094d-194b-4e80-a45b-81ddf1df0662" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.043990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6937094d-194b-4e80-a45b-81ddf1df0662" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.043990] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6937094d-194b-4e80-a45b-81ddf1df0662',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.061793] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.061881] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.062442] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.063039] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.063039] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.063039] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-3c12d569-659e-442c-a3b2-b297fa1a48a1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.108742] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.368805] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80ef938a-a7c9-4e4d-ad0e-bc258f6ec181 [ 679.368805] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.368805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.368805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.368805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.368805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.368805] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80ef938a-a7c9-4e4d-ad0e-bc258f6ec181 already deleted. [ 679.368805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80ef938a-a7c9-4e4d-ad0e-bc258f6ec181" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.548045] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6937094d-194b-4e80-a45b-81ddf1df0662 [ 679.548316] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.548474] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.548548] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.548941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.549049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.549268] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6937094d-194b-4e80-a45b-81ddf1df0662 already deleted. [ 679.549424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6937094d-194b-4e80-a45b-81ddf1df0662" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.611625] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.611819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.611922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.612270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.612451] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.612491] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be created. [ 679.645572] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.645897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.645897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.646068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.647237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.663492] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: UNINITIALIZED for 2s [ 680.695253] env[70535]: INFO networking_nsxv3.common.synchronization [None req-990464ec-1b32-4c2a-8e2f-8deae7a3d44b None None] Enqueued Resource ID: 0fc00f39-b87f-417c-87ce-3a1d75440f11 with Priority: HIGHEST for action port [ 680.695253] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fc00f39-b87f-417c-87ce-3a1d75440f11 with Priority: HIGHEST for action port [ 680.695253] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fc00f39-b87f-417c-87ce-3a1d75440f11 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.695253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fc00f39-b87f-417c-87ce-3a1d75440f11" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.695633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fc00f39-b87f-417c-87ce-3a1d75440f11" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.695633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fc00f39-b87f-417c-87ce-3a1d75440f11" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.695633] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fc00f39-b87f-417c-87ce-3a1d75440f11',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.727957] env[70535]: INFO networking_nsxv3.common.synchronization [req-b9de1bf3-70f1-4b51-96c5-edb26ba0ce49 req-184b8ccf-efa9-4301-ade0-4a0fc4521dab tempest-ServersWithSpecificFlavorTestJSON-86157586 tempest-ServersWithSpecificFlavorTestJSON-86157586-project-member] Enqueued Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_members [ 680.728745] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_members [ 680.729325] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b3e2660-4c57-4d95-a486-449e2bf37488 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.729511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.729673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.729964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.730181] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.730664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.730664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.730762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.730971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.731116] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.832238] env[70535]: INFO networking_nsxv3.common.synchronization [req-1121cbf8-9484-48fd-a608-c990af147e58 req-2bb03283-674d-43cb-877e-e7a54e4b2565 service nova] Enqueued Resource ID: 5c0519b9-5948-4844-8e1d-20705cb47261 with Priority: HIGHEST for action security_group_rules [ 680.835603] env[70535]: INFO networking_nsxv3.common.synchronization [req-1121cbf8-9484-48fd-a608-c990af147e58 req-2bb03283-674d-43cb-877e-e7a54e4b2565 service nova] Enqueued Resource ID: 5c0519b9-5948-4844-8e1d-20705cb47261 with Priority: HIGHEST for action security_group_members [ 680.835603] env[70535]: INFO networking_nsxv3.common.synchronization [req-1121cbf8-9484-48fd-a608-c990af147e58 req-2bb03283-674d-43cb-877e-e7a54e4b2565 service nova] Enqueued Resource ID: 3c12d569-659e-442c-a3b2-b297fa1a48a1 with Priority: HIGHEST for action port [ 680.835603] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c0519b9-5948-4844-8e1d-20705cb47261 with Priority: HIGHEST for action security_group_rules [ 680.835603] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c0519b9-5948-4844-8e1d-20705cb47261 with Priority: HIGHEST for action security_group_members [ 680.835603] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c12d569-659e-442c-a3b2-b297fa1a48a1 with Priority: HIGHEST for action port [ 680.835603] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c0519b9-5948-4844-8e1d-20705cb47261 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.835603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.835603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.835603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.835603] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c0519b9-5948-4844-8e1d-20705cb47261',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.835603] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c0519b9-5948-4844-8e1d-20705cb47261 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.835603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.835603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.835603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.836307] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.836307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.836307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.836307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.836307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.836307] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c0519b9-5948-4844-8e1d-20705cb47261',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.837383] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c12d569-659e-442c-a3b2-b297fa1a48a1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.837506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c12d569-659e-442c-a3b2-b297fa1a48a1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.837550] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c12d569-659e-442c-a3b2-b297fa1a48a1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.837703] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c12d569-659e-442c-a3b2-b297fa1a48a1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.837772] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c12d569-659e-442c-a3b2-b297fa1a48a1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.952249] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb in Status: SUCCESS [ 680.952249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.996861] env[70535]: INFO networking_nsxv3.common.synchronization [None req-2f6f0251-ba24-408a-b44a-ac6d3e48cb61 None None] Enqueued Resource ID: 8fd76be6-1c3b-42d6-96cb-3d18bc82bb36 with Priority: HIGHEST for action port [ 680.998908] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fd76be6-1c3b-42d6-96cb-3d18bc82bb36 with Priority: HIGHEST for action port [ 680.998908] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fd76be6-1c3b-42d6-96cb-3d18bc82bb36 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.998908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fd76be6-1c3b-42d6-96cb-3d18bc82bb36" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.998908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fd76be6-1c3b-42d6-96cb-3d18bc82bb36" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.998908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fd76be6-1c3b-42d6-96cb-3d18bc82bb36" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.998908] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fd76be6-1c3b-42d6-96cb-3d18bc82bb36',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.198704] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fc00f39-b87f-417c-87ce-3a1d75440f11 [ 681.200210] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.200210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.200210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.200210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.200210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.200210] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fc00f39-b87f-417c-87ce-3a1d75440f11 already deleted. [ 681.200210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fc00f39-b87f-417c-87ce-3a1d75440f11" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.234792] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.234792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.234792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.234792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.234792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.234792] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.235232] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.235443] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.235616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.235760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.235895] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 already deleted. [ 681.236046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.343205] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c0519b9-5948-4844-8e1d-20705cb47261 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.343205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.343205] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c0519b9-5948-4844-8e1d-20705cb47261',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.343205] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c12d569-659e-442c-a3b2-b297fa1a48a1 with status ACTIVE [ 681.343205] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.343701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.343701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.343701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.343701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.343907] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.344023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.344087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.345131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.345131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.345131] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.345131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.345131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.345131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.347324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.347490] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c12d569-659e-442c-a3b2-b297fa1a48a1 is going to be updated. [ 681.376682] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.377956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.377956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.378219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.378419] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.378619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c12d569-659e-442c-a3b2-b297fa1a48a1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.444553] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-138 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.444718] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-138" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.445293] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-138" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.445293] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-138" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.445551] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.445718] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.445840] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.446429] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.446429] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.446429] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.446554] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.446667] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.446778] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.447085] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.447085] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.447199] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.450911] env[70535]: INFO networking_nsxv3.common.synchronization [None req-62b1de07-6611-48da-9dee-ed66b31e2827 None None] Enqueued Resource ID: 8c7c67c6-1dc8-44ac-b5c7-8bd40bec7069 with Priority: HIGHEST for action port [ 681.452365] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c7c67c6-1dc8-44ac-b5c7-8bd40bec7069 with Priority: HIGHEST for action port [ 681.452947] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c7c67c6-1dc8-44ac-b5c7-8bd40bec7069 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.453110] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c7c67c6-1dc8-44ac-b5c7-8bd40bec7069" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.453172] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c7c67c6-1dc8-44ac-b5c7-8bd40bec7069" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.453536] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c7c67c6-1dc8-44ac-b5c7-8bd40bec7069" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.453536] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c7c67c6-1dc8-44ac-b5c7-8bd40bec7069',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.482225] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.483484] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 681.483587] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.483878] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-138" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.484324] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-908ecde2-02fe-468d-9f1b-0ca01618a959 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.485394] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-908ecde2-02fe-468d-9f1b-0ca01618a959" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.485394] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-908ecde2-02fe-468d-9f1b-0ca01618a959" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.485394] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-908ecde2-02fe-468d-9f1b-0ca01618a959" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.485394] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('908ecde2-02fe-468d-9f1b-0ca01618a959',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.493419] env[70535]: INFO networking_nsxv3.common.synchronization [req-e4c9a444-50f7-44a5-ae8c-205b2ed6929c req-8610f036-99ba-4ff4-90d1-65a3dd91735a tempest-AttachInterfacesV270Test-47759930 tempest-AttachInterfacesV270Test-47759930-project-member] Enqueued Resource ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 with Priority: HIGHEST for action security_group_members [ 681.493981] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 with Priority: HIGHEST for action security_group_members [ 681.494328] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-679d2a4f-8236-41e0-99ab-1f6326515c29 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.494489] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.494557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.494760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.494918] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.495074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.495142] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.495291] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.495375] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.495489] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('679d2a4f-8236-41e0-99ab-1f6326515c29',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.502980] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fd76be6-1c3b-42d6-96cb-3d18bc82bb36 [ 681.502980] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.502980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.502980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.502980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.502980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.502980] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fd76be6-1c3b-42d6-96cb-3d18bc82bb36 already deleted. [ 681.502980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fd76be6-1c3b-42d6-96cb-3d18bc82bb36" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.677988] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 681.678241] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.678448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.678801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.679386] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.679386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.679386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.679979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.679979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.679979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.679979] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.850369] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c0519b9-5948-4844-8e1d-20705cb47261',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.959085] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c7c67c6-1dc8-44ac-b5c7-8bd40bec7069 [ 681.959347] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.959504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.959577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.959801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.959895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.960262] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c7c67c6-1dc8-44ac-b5c7-8bd40bec7069 already deleted. [ 681.960262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c7c67c6-1dc8-44ac-b5c7-8bd40bec7069" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.988276] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.990741] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.990741] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.990741] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.990741] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.990741] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 908ecde2-02fe-468d-9f1b-0ca01618a959 not found, creating... [ 681.990741] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.990741] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.990741] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.990741] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.990741] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.991244] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.991244] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.991517] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.991819] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.992054] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.992296] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 908ecde2-02fe-468d-9f1b-0ca01618a959 is going to be created. [ 682.001269] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.001269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.001269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.001269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.001269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.001642] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.001857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.001857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.002115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.002864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.002864] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 is going to be updated. [ 682.025898] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.025898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.025898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.025898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.025898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.025898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-908ecde2-02fe-468d-9f1b-0ca01618a959" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.046501] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.046501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.046501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.046501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.046501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.076575] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 in Status: IN_PROGRESS for 2s [ 682.184211] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.184404] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.184497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.184755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.184932] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.185065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.185161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.185432] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.185546] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.185668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.185855] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.185965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.186244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.186244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.186443] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.186551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.186618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.190310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.190576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.190576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.190881] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.301507] env[70535]: INFO networking_nsxv3.common.synchronization [None req-e9f1addc-1415-46bb-babd-8ca6e09e5ea5 None None] Enqueued Resource ID: b298942b-6620-4a9a-ac43-ac9a6aa53b81 with Priority: HIGHEST for action port [ 682.302462] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b298942b-6620-4a9a-ac43-ac9a6aa53b81 with Priority: HIGHEST for action port [ 682.302532] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-b298942b-6620-4a9a-ac43-ac9a6aa53b81 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.302690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b298942b-6620-4a9a-ac43-ac9a6aa53b81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.302769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b298942b-6620-4a9a-ac43-ac9a6aa53b81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.303049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b298942b-6620-4a9a-ac43-ac9a6aa53b81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.303851] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b298942b-6620-4a9a-ac43-ac9a6aa53b81',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.354170] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.354392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.354392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.354653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.354741] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.354801] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c0519b9-5948-4844-8e1d-20705cb47261 is going to be created. [ 682.381057] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.381160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.381224] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.381432] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.381558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.393042] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c0519b9-5948-4844-8e1d-20705cb47261 in Status: UNINITIALIZED for 2s [ 682.638836] env[70535]: INFO networking_nsxv3.common.synchronization [req-fec45354-3085-4abe-b231-8d0d0c2feeae req-a8f712eb-18be-4cac-9255-011dbdf653a4 tempest-VolumesAssistedSnapshotsTest-117852516 tempest-VolumesAssistedSnapshotsTest-117852516-project-member] Enqueued Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGHEST for action security_group_members [ 682.639384] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGHEST for action security_group_members [ 682.639693] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-90c4bd0b-6551-40c3-9e23-945c4ab91af0 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.639821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.639890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.641822] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.641822] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.641822] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.641822] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.641822] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.641822] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.641822] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90c4bd0b-6551-40c3-9e23-945c4ab91af0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.694454] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52023f52-3978-48e2-8510-00221c047d2e: rpc.has_security_group_logging(os_id): False [ 682.716271] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.716271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.716271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.716271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.716271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.716271] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.716271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.716271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.716271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.716271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.716271] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.716271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.716271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.716271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.716271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.716883] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.719425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.719425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.719425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.719425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.719425] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be created. [ 682.792989] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.792989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.792989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.792989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.792989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.805894] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b298942b-6620-4a9a-ac43-ac9a6aa53b81 [ 682.806142] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.806308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.806365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.806808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.806808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.806808] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b298942b-6620-4a9a-ac43-ac9a6aa53b81 already deleted. [ 682.806808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b298942b-6620-4a9a-ac43-ac9a6aa53b81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.813186] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 682.832279] env[70535]: INFO networking_nsxv3.common.synchronization [req-b9de1bf3-70f1-4b51-96c5-edb26ba0ce49 req-2bb3999e-6b80-475d-9c01-9d4098a0f462 service nova] Enqueued Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_rules [ 682.832482] env[70535]: INFO networking_nsxv3.common.synchronization [req-b9de1bf3-70f1-4b51-96c5-edb26ba0ce49 req-2bb3999e-6b80-475d-9c01-9d4098a0f462 service nova] Enqueued Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_members [ 682.832622] env[70535]: INFO networking_nsxv3.common.synchronization [req-b9de1bf3-70f1-4b51-96c5-edb26ba0ce49 req-2bb3999e-6b80-475d-9c01-9d4098a0f462 service nova] Enqueued Resource ID: 908ecde2-02fe-468d-9f1b-0ca01618a959 with Priority: HIGHEST for action port [ 682.833175] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_rules [ 682.833329] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_members [ 682.833429] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 908ecde2-02fe-468d-9f1b-0ca01618a959 with Priority: HIGHEST for action port [ 682.833700] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b3e2660-4c57-4d95-a486-449e2bf37488 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.833829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.833956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.834108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.834182] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.836893] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b3e2660-4c57-4d95-a486-449e2bf37488 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.836893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.836893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.836893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.836893] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.836893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.836893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.836893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.836893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.836893] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.836893] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-908ecde2-02fe-468d-9f1b-0ca01618a959 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.836893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-908ecde2-02fe-468d-9f1b-0ca01618a959" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.836893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-908ecde2-02fe-468d-9f1b-0ca01618a959" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.837460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-908ecde2-02fe-468d-9f1b-0ca01618a959" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.837460] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('908ecde2-02fe-468d-9f1b-0ca01618a959',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.095284] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-934 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.095635] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-934" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.095635] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-934" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.096083] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-934" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.096467] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.096689] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.096865] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.097053] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.097181] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.097707] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.097707] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.097707] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.097855] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.097855] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.097974] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.098128] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.121373] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.121373] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 683.121373] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.121373] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-934" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.122229] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-25ba8f63-d341-4c74-bbf7-9a1d065f836a taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.122419] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-25ba8f63-d341-4c74-bbf7-9a1d065f836a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.123254] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-25ba8f63-d341-4c74-bbf7-9a1d065f836a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.124226] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-25ba8f63-d341-4c74-bbf7-9a1d065f836a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.124226] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25ba8f63-d341-4c74-bbf7-9a1d065f836a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.144623] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.144785] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.144853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.145488] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.145901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.146360] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.146990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.147106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.147332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.147427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.147518] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 already deleted. [ 683.147636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.345319] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.346536] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b3e2660-4c57-4d95-a486-449e2bf37488 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.349101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.349101] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 908ecde2-02fe-468d-9f1b-0ca01618a959 with status ACTIVE [ 683.349101] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.349101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.349101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.349101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.349101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.349101] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.349101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.349101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.349101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.349101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.351910] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.352115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.352203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.353013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.353013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.353013] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 908ecde2-02fe-468d-9f1b-0ca01618a959 is going to be updated. [ 683.375613] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.376533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.376720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.377128] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.377251] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.378035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-908ecde2-02fe-468d-9f1b-0ca01618a959" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.626789] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.629034] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.629034] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.629034] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.629034] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.629034] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 25ba8f63-d341-4c74-bbf7-9a1d065f836a not found, creating... [ 683.629034] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.629725] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.629990] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.630795] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.630795] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.631461] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.631637] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.632100] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.632100] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.632998] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.632998] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 25ba8f63-d341-4c74-bbf7-9a1d065f836a is going to be created. [ 683.654691] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.656235] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.656235] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.656235] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.656235] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.656235] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-25ba8f63-d341-4c74-bbf7-9a1d065f836a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.856171] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.092849] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 in Status: SUCCESS [ 684.092849] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 deletion is rescheduled due to dependency. [ 684.092849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.359913] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.361147] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.361147] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.361147] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.361147] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.361147] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 is going to be created. [ 684.395881] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.397575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.397575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.397575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.398962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.412872] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c0519b9-5948-4844-8e1d-20705cb47261 in Status: SUCCESS [ 684.412872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.413405] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 in Status: UNINITIALIZED for 2s [ 684.413920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.414195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.414829] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.415026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.415125] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.415324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.415415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.416038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.416133] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c0519b9-5948-4844-8e1d-20705cb47261',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.491515] env[70535]: INFO networking_nsxv3.common.synchronization [req-fec45354-3085-4abe-b231-8d0d0c2feeae req-1146203a-501d-440d-852d-8dc587464e28 service nova] Enqueued Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGHEST for action security_group_rules [ 684.491706] env[70535]: INFO networking_nsxv3.common.synchronization [req-fec45354-3085-4abe-b231-8d0d0c2feeae req-1146203a-501d-440d-852d-8dc587464e28 service nova] Enqueued Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGHEST for action security_group_members [ 684.491824] env[70535]: INFO networking_nsxv3.common.synchronization [req-fec45354-3085-4abe-b231-8d0d0c2feeae req-1146203a-501d-440d-852d-8dc587464e28 service nova] Enqueued Resource ID: 25ba8f63-d341-4c74-bbf7-9a1d065f836a with Priority: HIGHEST for action port [ 684.492473] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGHEST for action security_group_rules [ 684.492556] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGHEST for action security_group_members [ 684.492653] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ba8f63-d341-4c74-bbf7-9a1d065f836a with Priority: HIGHEST for action port [ 684.494381] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.494381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.494381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.494381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.494381] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90c4bd0b-6551-40c3-9e23-945c4ab91af0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.494762] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-90c4bd0b-6551-40c3-9e23-945c4ab91af0 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.494762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.494762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.494914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.495086] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.495184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.495254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.495405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.496106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.496106] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90c4bd0b-6551-40c3-9e23-945c4ab91af0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.496361] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-25ba8f63-d341-4c74-bbf7-9a1d065f836a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.496485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25ba8f63-d341-4c74-bbf7-9a1d065f836a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.496573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25ba8f63-d341-4c74-bbf7-9a1d065f836a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.496694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25ba8f63-d341-4c74-bbf7-9a1d065f836a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.496780] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25ba8f63-d341-4c74-bbf7-9a1d065f836a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.832797] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 684.832797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.920701] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c0519b9-5948-4844-8e1d-20705cb47261 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.920944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.921115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.921504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.921745] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.921930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.922085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.922432] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.922581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.922748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.923026] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c0519b9-5948-4844-8e1d-20705cb47261 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.923345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.923345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.923629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.923866] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.925361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.925511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.925669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.925829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.925974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.926162] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c0519b9-5948-4844-8e1d-20705cb47261',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.999544] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-90c4bd0b-6551-40c3-9e23-945c4ab91af0 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.999544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.000055] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90c4bd0b-6551-40c3-9e23-945c4ab91af0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.001344] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25ba8f63-d341-4c74-bbf7-9a1d065f836a with status ACTIVE [ 685.001770] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.001895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.001966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.002290] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.002432] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.002933] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.003177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.003252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.003551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.004016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.004016] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.004180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.004287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.004532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.004663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.006216] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25ba8f63-d341-4c74-bbf7-9a1d065f836a is going to be updated. [ 685.040649] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.040828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.040898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.041133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.041270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.041471] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25ba8f63-d341-4c74-bbf7-9a1d065f836a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.089915] env[70535]: INFO networking_nsxv3.common.synchronization [None req-e1427f3d-968d-4631-8884-05035e078861 tempest-AttachInterfacesUnderV243Test-1177928744 tempest-AttachInterfacesUnderV243Test-1177928744-project-member] Enqueued Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_rules [ 685.091096] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_rules [ 685.093653] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf92eefc-a553-4c8e-a807-3110974b4799 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.093653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.093653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.093653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.093653] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.418439] env[70535]: INFO networking_nsxv3.common.synchronization [None req-4175be77-8a24-4145-8943-4b814613b6af tempest-AttachInterfacesUnderV243Test-1177928744 tempest-AttachInterfacesUnderV243Test-1177928744-project-member] Enqueued Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_rules [ 685.418439] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_rules [ 685.419579] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf92eefc-a553-4c8e-a807-3110974b4799 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.419866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.430149] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c0519b9-5948-4844-8e1d-20705cb47261: rpc.has_security_group_logging(os_id): False [ 685.458491] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.458491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.458491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.459842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.459842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.459842] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.459842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.459842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.459842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.459842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.460623] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.460623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.460623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.461933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.462137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.462553] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.462723] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.462866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.463951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.463951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.464228] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c0519b9-5948-4844-8e1d-20705cb47261 is going to be created. [ 685.507742] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90c4bd0b-6551-40c3-9e23-945c4ab91af0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.540638] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.540834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.540834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.541231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.541333] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.555382] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c0519b9-5948-4844-8e1d-20705cb47261 in Status: IN_PROGRESS for 2s [ 685.631429] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.631581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.631640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.631863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.631948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.632117] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf92eefc-a553-4c8e-a807-3110974b4799 already deleted. [ 685.632162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.633342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.633342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.633342] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.796079] env[70535]: INFO networking_nsxv3.common.synchronization [req-d987f285-a348-4e69-ae3a-67f6f17ed270 req-e4b7627b-f757-4d60-96f0-941d833a522e tempest-ServerPasswordTestJSON-1888714512 tempest-ServerPasswordTestJSON-1888714512-project-member] Enqueued Resource ID: eda75f17-393d-4d95-8a9b-a7924138f446 with Priority: HIGHEST for action security_group_members [ 685.796704] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda75f17-393d-4d95-8a9b-a7924138f446 with Priority: HIGHEST for action security_group_members [ 685.797073] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda75f17-393d-4d95-8a9b-a7924138f446 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.797169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.797229] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.797774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.797774] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.797774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.797901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.797945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.798384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.798542] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eda75f17-393d-4d95-8a9b-a7924138f446',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.820605] env[70535]: INFO networking_nsxv3.common.synchronization [None req-994c2105-c23a-486f-a6c7-e29baffe2bce None None] Enqueued Resource ID: d7280272-3616-44b3-9484-c207c031ae6f with Priority: HIGHEST for action port [ 685.821262] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7280272-3616-44b3-9484-c207c031ae6f with Priority: HIGHEST for action port [ 685.822748] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7280272-3616-44b3-9484-c207c031ae6f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.822748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7280272-3616-44b3-9484-c207c031ae6f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.822748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7280272-3616-44b3-9484-c207c031ae6f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.822748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7280272-3616-44b3-9484-c207c031ae6f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.822748] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7280272-3616-44b3-9484-c207c031ae6f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.013653] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.014673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.014893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.015262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.015477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.017222] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 is going to be created. [ 686.048026] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.048257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.048257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.048481] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.048659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.062076] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 in Status: UNINITIALIZED for 2s [ 686.156792] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.156792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.157115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.157430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.157555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.157695] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf92eefc-a553-4c8e-a807-3110974b4799 already deleted. [ 686.157825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.302366] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.305570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.305570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.305570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.305570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.305570] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.305570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.305570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.305570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.305570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.305570] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eda75f17-393d-4d95-8a9b-a7924138f446 already deleted. [ 686.305570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.325751] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7280272-3616-44b3-9484-c207c031ae6f [ 686.325751] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.325751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.325751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.325751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.325751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.325751] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7280272-3616-44b3-9484-c207c031ae6f already deleted. [ 686.325751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7280272-3616-44b3-9484-c207c031ae6f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.433579] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 in Status: SUCCESS [ 686.433579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.433579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.433579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.433579] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.433579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.433579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.434701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.435272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.438085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.438085] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.940868] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.949294] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-736 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.950128] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-736" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.950128] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-736" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.950128] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-736" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.950418] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.950549] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.950599] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.951040] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.951040] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.951689] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.953292] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.954785] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.954881] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.955016] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.955135] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.955286] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.983095] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.983514] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 686.983514] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.984313] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-736" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.984313] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-baeb7226-cd8b-40c6-9ed0-9a382d04ccc3 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.984313] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-baeb7226-cd8b-40c6-9ed0-9a382d04ccc3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.984313] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-baeb7226-cd8b-40c6-9ed0-9a382d04ccc3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.989763] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-baeb7226-cd8b-40c6-9ed0-9a382d04ccc3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.989763] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baeb7226-cd8b-40c6-9ed0-9a382d04ccc3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.446023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b3e2660-4c57-4d95-a486-449e2bf37488: rpc.has_security_group_logging(os_id): False [ 687.475230] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.475230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.475230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.475230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.475230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.475230] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.475230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.475230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.476420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.476532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.476747] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 is going to be created. [ 687.493767] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.495384] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.495384] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.495384] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.495384] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.495384] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port baeb7226-cd8b-40c6-9ed0-9a382d04ccc3 not found, creating... [ 687.495384] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.495799] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.495799] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.495920] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.495979] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.497411] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.497411] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.497411] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.497411] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.501392] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.501392] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: baeb7226-cd8b-40c6-9ed0-9a382d04ccc3 is going to be created. [ 687.525597] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.525811] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.525970] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.526296] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.526560] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.526802] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-baeb7226-cd8b-40c6-9ed0-9a382d04ccc3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.549089] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.549271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.549314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.549530] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.549702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.566454] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 in Status: IN_PROGRESS for 2s [ 687.570758] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c0519b9-5948-4844-8e1d-20705cb47261 in Status: SUCCESS [ 687.570999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.824894] env[70535]: INFO networking_nsxv3.common.synchronization [None req-c240c126-af65-418e-9c7f-fab7e6383f03 None None] Enqueued Resource ID: 7653434f-371c-45f6-94ca-629b4d88ef5c with Priority: HIGHEST for action port [ 687.825700] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7653434f-371c-45f6-94ca-629b4d88ef5c with Priority: HIGHEST for action port [ 687.825700] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-7653434f-371c-45f6-94ca-629b4d88ef5c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.826013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7653434f-371c-45f6-94ca-629b4d88ef5c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.826013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7653434f-371c-45f6-94ca-629b4d88ef5c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.826166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7653434f-371c-45f6-94ca-629b4d88ef5c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.826395] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7653434f-371c-45f6-94ca-629b4d88ef5c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.076231] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 in Status: SUCCESS [ 688.076539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.076756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.076997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.077232] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.077402] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.077480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.078791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.078791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.078791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.078791] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90c4bd0b-6551-40c3-9e23-945c4ab91af0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.336505] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7653434f-371c-45f6-94ca-629b4d88ef5c [ 688.336505] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.336505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.336505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.336505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.336505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.336505] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7653434f-371c-45f6-94ca-629b4d88ef5c already deleted. [ 688.336505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7653434f-371c-45f6-94ca-629b4d88ef5c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.582836] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90c4bd0b-6551-40c3-9e23-945c4ab91af0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.084988] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90c4bd0b-6551-40c3-9e23-945c4ab91af0: rpc.has_security_group_logging(os_id): False [ 689.115664] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.115664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.115985] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.116218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.116218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.116756] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.116756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.116756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.117461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.117461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.117461] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 is going to be created. [ 689.211191] env[70535]: INFO networking_nsxv3.common.synchronization [req-4d7041fc-52c8-4bba-a62e-7722ae7a2884 req-eb8db348-ec9d-4b87-bb65-8b6b5b5c95c2 tempest-ListImageFiltersTestJSON-1844606616 tempest-ListImageFiltersTestJSON-1844606616-project-member] Enqueued Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_members [ 689.211191] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_members [ 689.212442] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.213515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.213721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.215170] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.215342] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.215491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.215567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.215884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.215884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.216061] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.236671] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.236826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.236879] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.237150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.237349] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.250833] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 in Status: IN_PROGRESS for 2s [ 689.315082] env[70535]: INFO networking_nsxv3.common.synchronization [req-d987f285-a348-4e69-ae3a-67f6f17ed270 req-df793b7d-c59d-42a0-9912-784d7bf1825b service nova] Enqueued Resource ID: eda75f17-393d-4d95-8a9b-a7924138f446 with Priority: HIGHEST for action security_group_rules [ 689.315082] env[70535]: INFO networking_nsxv3.common.synchronization [req-d987f285-a348-4e69-ae3a-67f6f17ed270 req-df793b7d-c59d-42a0-9912-784d7bf1825b service nova] Enqueued Resource ID: eda75f17-393d-4d95-8a9b-a7924138f446 with Priority: HIGHEST for action security_group_members [ 689.315082] env[70535]: INFO networking_nsxv3.common.synchronization [req-d987f285-a348-4e69-ae3a-67f6f17ed270 req-df793b7d-c59d-42a0-9912-784d7bf1825b service nova] Enqueued Resource ID: baeb7226-cd8b-40c6-9ed0-9a382d04ccc3 with Priority: HIGHEST for action port [ 689.315722] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda75f17-393d-4d95-8a9b-a7924138f446 with Priority: HIGHEST for action security_group_rules [ 689.315887] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda75f17-393d-4d95-8a9b-a7924138f446 with Priority: HIGHEST for action security_group_members [ 689.316041] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baeb7226-cd8b-40c6-9ed0-9a382d04ccc3 with Priority: HIGHEST for action port [ 689.319140] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eda75f17-393d-4d95-8a9b-a7924138f446 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.319140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.319140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.319140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.319140] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eda75f17-393d-4d95-8a9b-a7924138f446',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.319140] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda75f17-393d-4d95-8a9b-a7924138f446 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.319488] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.319488] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.320678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.320678] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.320678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.320678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.320678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.320678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.320678] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eda75f17-393d-4d95-8a9b-a7924138f446',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.322239] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-baeb7226-cd8b-40c6-9ed0-9a382d04ccc3 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.322777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-baeb7226-cd8b-40c6-9ed0-9a382d04ccc3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.322975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-baeb7226-cd8b-40c6-9ed0-9a382d04ccc3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.323418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-baeb7226-cd8b-40c6-9ed0-9a382d04ccc3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.324282] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baeb7226-cd8b-40c6-9ed0-9a382d04ccc3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.585062] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 in Status: SUCCESS [ 689.585593] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.727160] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.727160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.727160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.727160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.727160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.727160] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.727160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.727160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.727160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.727160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.727160] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 already deleted. [ 689.727160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.827602] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eda75f17-393d-4d95-8a9b-a7924138f446',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.827602] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda75f17-393d-4d95-8a9b-a7924138f446 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.827602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.833824] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port baeb7226-cd8b-40c6-9ed0-9a382d04ccc3 with status ACTIVE [ 689.834055] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.834192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.834350] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.834698] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.834698] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.834810] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.834865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.834949] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.835249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.835249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.835366] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.835366] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.835462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.836079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.836079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.836079] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: baeb7226-cd8b-40c6-9ed0-9a382d04ccc3 is going to be updated. [ 689.863388] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.863541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.863614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.864235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.864235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.864235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-baeb7226-cd8b-40c6-9ed0-9a382d04ccc3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.011050] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.012787] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.013405] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.014756] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.015300] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.015668] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.016189] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.016727] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.017153] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.017861] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.020958] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.020958] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.020958] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.020958] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.020958] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.020958] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.054193] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.054354] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 690.054496] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.054693] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.055271] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-96fc8356-1594-4a9e-83c2-bac4fb43ec09 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.055271] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-96fc8356-1594-4a9e-83c2-bac4fb43ec09" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.055440] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-96fc8356-1594-4a9e-83c2-bac4fb43ec09" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.055661] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-96fc8356-1594-4a9e-83c2-bac4fb43ec09" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.055801] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96fc8356-1594-4a9e-83c2-bac4fb43ec09',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.328857] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eda75f17-393d-4d95-8a9b-a7924138f446',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.561769] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.561769] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.561769] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.561769] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.561769] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.561769] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 96fc8356-1594-4a9e-83c2-bac4fb43ec09 not found, creating... [ 690.561769] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.561769] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.562310] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.565097] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.565097] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.565097] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.565097] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.565097] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.565097] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.565097] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.565097] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 96fc8356-1594-4a9e-83c2-bac4fb43ec09 is going to be created. [ 690.589915] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.589915] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.591545] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.591673] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.591932] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.592410] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-96fc8356-1594-4a9e-83c2-bac4fb43ec09" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.749533] env[70535]: INFO networking_nsxv3.common.synchronization [req-a7ef68ce-5416-403f-9310-082f3fdb4bd5 req-fe57e48b-70b9-4778-8875-e1a879e47949 tempest-ServerDiagnosticsTest-1292803537 tempest-ServerDiagnosticsTest-1292803537-project-member] Enqueued Resource ID: 81327d43-2c13-4e7b-b63b-d04a175b637e with Priority: HIGHEST for action security_group_members [ 690.750806] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81327d43-2c13-4e7b-b63b-d04a175b637e with Priority: HIGHEST for action security_group_members [ 690.751312] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-81327d43-2c13-4e7b-b63b-d04a175b637e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.751507] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.751947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.752591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.752846] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.753448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.753574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.754381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.754381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.754381] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81327d43-2c13-4e7b-b63b-d04a175b637e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.832811] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.833060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.833170] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.833493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.833629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.833824] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eda75f17-393d-4d95-8a9b-a7924138f446 is going to be created. [ 690.868161] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.868161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.868161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.868161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.868161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.903622] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda75f17-393d-4d95-8a9b-a7924138f446 in Status: UNINITIALIZED for 2s [ 691.258059] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.258972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.259377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.259954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.260405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.263030] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.263030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.263030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.263030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.263030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.263030] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81327d43-2c13-4e7b-b63b-d04a175b637e is going to be updated. [ 691.269557] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 in Status: SUCCESS [ 691.270132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.301892] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.301892] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.301892] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.301892] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.301892] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.319962] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81327d43-2c13-4e7b-b63b-d04a175b637e in Status: IN_PROGRESS for 2s [ 691.420494] env[70535]: INFO networking_nsxv3.common.synchronization [None req-3aac17f7-3fbe-4330-9cbd-060087753ac6 None None] Enqueued Resource ID: 48cbd959-3bec-4578-9ddc-1b37a1884edd with Priority: HIGHEST for action port [ 691.420494] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48cbd959-3bec-4578-9ddc-1b37a1884edd with Priority: HIGHEST for action port [ 691.420494] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-48cbd959-3bec-4578-9ddc-1b37a1884edd taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.420884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48cbd959-3bec-4578-9ddc-1b37a1884edd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.423675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48cbd959-3bec-4578-9ddc-1b37a1884edd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.423675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48cbd959-3bec-4578-9ddc-1b37a1884edd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.423675] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48cbd959-3bec-4578-9ddc-1b37a1884edd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.924920] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48cbd959-3bec-4578-9ddc-1b37a1884edd [ 691.925292] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.925360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.925444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.929045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.929045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.929045] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48cbd959-3bec-4578-9ddc-1b37a1884edd already deleted. [ 691.929045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48cbd959-3bec-4578-9ddc-1b37a1884edd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.098109] env[70535]: INFO networking_nsxv3.common.synchronization [None req-eb946cf3-974e-46af-a759-4a0420c15b1a None None] Enqueued Resource ID: 18a645e2-66a6-4f75-9cf5-7cd32b739342 with Priority: HIGHEST for action port [ 692.100104] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18a645e2-66a6-4f75-9cf5-7cd32b739342 with Priority: HIGHEST for action port [ 692.100844] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-18a645e2-66a6-4f75-9cf5-7cd32b739342 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.101027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18a645e2-66a6-4f75-9cf5-7cd32b739342" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.101061] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18a645e2-66a6-4f75-9cf5-7cd32b739342" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.101332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18a645e2-66a6-4f75-9cf5-7cd32b739342" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.101538] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18a645e2-66a6-4f75-9cf5-7cd32b739342',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.202136] env[70535]: INFO networking_nsxv3.common.synchronization [None req-16566020-fa08-4aff-a6a9-0a5fff57dd05 None None] Enqueued Resource ID: 01f685e6-e049-4c1c-8714-2842c44fcc2d with Priority: HIGHEST for action port [ 692.202136] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01f685e6-e049-4c1c-8714-2842c44fcc2d with Priority: HIGHEST for action port [ 692.203052] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-01f685e6-e049-4c1c-8714-2842c44fcc2d taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.203338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01f685e6-e049-4c1c-8714-2842c44fcc2d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.203338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01f685e6-e049-4c1c-8714-2842c44fcc2d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.203749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01f685e6-e049-4c1c-8714-2842c44fcc2d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.203872] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01f685e6-e049-4c1c-8714-2842c44fcc2d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.604148] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18a645e2-66a6-4f75-9cf5-7cd32b739342 [ 692.605652] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.605652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.605652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.605652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.605652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.605652] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18a645e2-66a6-4f75-9cf5-7cd32b739342 already deleted. [ 692.605652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18a645e2-66a6-4f75-9cf5-7cd32b739342" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.671186] env[70535]: INFO networking_nsxv3.common.synchronization [req-4d7041fc-52c8-4bba-a62e-7722ae7a2884 req-69073ecd-a1c7-4828-b3e9-743468432292 service nova] Enqueued Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_rules [ 692.671522] env[70535]: INFO networking_nsxv3.common.synchronization [req-4d7041fc-52c8-4bba-a62e-7722ae7a2884 req-69073ecd-a1c7-4828-b3e9-743468432292 service nova] Enqueued Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_members [ 692.671732] env[70535]: INFO networking_nsxv3.common.synchronization [req-4d7041fc-52c8-4bba-a62e-7722ae7a2884 req-69073ecd-a1c7-4828-b3e9-743468432292 service nova] Enqueued Resource ID: 96fc8356-1594-4a9e-83c2-bac4fb43ec09 with Priority: HIGHEST for action port [ 692.676039] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_rules [ 692.676039] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_members [ 692.676039] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96fc8356-1594-4a9e-83c2-bac4fb43ec09 with Priority: HIGHEST for action port [ 692.676296] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.676724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.676724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.676935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.677056] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.678718] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.678718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.678718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.678718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.678718] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.678718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.678718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.679039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.679039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.679173] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.680755] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-96fc8356-1594-4a9e-83c2-bac4fb43ec09 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.680755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96fc8356-1594-4a9e-83c2-bac4fb43ec09" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.680755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96fc8356-1594-4a9e-83c2-bac4fb43ec09" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.680755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96fc8356-1594-4a9e-83c2-bac4fb43ec09" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.680755] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96fc8356-1594-4a9e-83c2-bac4fb43ec09',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.708507] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01f685e6-e049-4c1c-8714-2842c44fcc2d [ 692.709277] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.709277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.709277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.709277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.709535] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.709535] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01f685e6-e049-4c1c-8714-2842c44fcc2d already deleted. [ 692.709535] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01f685e6-e049-4c1c-8714-2842c44fcc2d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.919551] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda75f17-393d-4d95-8a9b-a7924138f446 in Status: SUCCESS [ 692.919551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.919551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.919551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.919551] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.919551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.919551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.919551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.919551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.919551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.919551] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eda75f17-393d-4d95-8a9b-a7924138f446',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.926604] env[70535]: INFO networking_nsxv3.common.synchronization [req-4b3ac720-fcdf-460b-bada-63b797661edc req-f190a3bc-318f-4770-a26c-dd562a573099 tempest-ServerDiagnosticsNegativeTest-84406442 tempest-ServerDiagnosticsNegativeTest-84406442-project-member] Enqueued Resource ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb with Priority: HIGHEST for action security_group_members [ 692.928545] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb with Priority: HIGHEST for action security_group_members [ 692.929286] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1dcacf3-cf94-4660-82d4-dac926fd56fb taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.929286] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.929286] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.929612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.931207] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.931817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.931817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.931817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.931817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.931817] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1dcacf3-cf94-4660-82d4-dac926fd56fb',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.181766] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.185349] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.185349] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.186447] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96fc8356-1594-4a9e-83c2-bac4fb43ec09 with status ACTIVE [ 693.187172] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.187348] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.187696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.187982] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.190763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.190763] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.190763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.190763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.190763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.190763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.190763] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.190763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.190763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.190763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.190763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.191234] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96fc8356-1594-4a9e-83c2-bac4fb43ec09 is going to be updated. [ 693.220622] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.220622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.220622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.220928] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.221113] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.221340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96fc8356-1594-4a9e-83c2-bac4fb43ec09" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.331578] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81327d43-2c13-4e7b-b63b-d04a175b637e in Status: SUCCESS [ 693.332063] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81327d43-2c13-4e7b-b63b-d04a175b637e deletion is rescheduled due to dependency. [ 693.332213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.421325] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda75f17-393d-4d95-8a9b-a7924138f446 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.421534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.421592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.421768] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.421932] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.422042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.422103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.422252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.422374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.422463] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.422616] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda75f17-393d-4d95-8a9b-a7924138f446 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.422703] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.422771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.422901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.423054] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.423143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.423210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.424119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.424119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.424119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.424119] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eda75f17-393d-4d95-8a9b-a7924138f446',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.437636] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.437816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.437907] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.438158] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.438297] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.438530] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.438657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.438700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.438864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.438942] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.439082] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb is going to be updated. [ 693.474789] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.475023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.475023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.475249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.475406] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.487269] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb in Status: IN_PROGRESS for 2s [ 693.685583] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.930131] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eda75f17-393d-4d95-8a9b-a7924138f446: rpc.has_security_group_logging(os_id): False [ 693.954405] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.954405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.954405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.954405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.954405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.954405] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.954405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.954405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.954405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.954405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.954405] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.954405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.955115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.955115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.955115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.955326] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.955326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.955428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.955481] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.955782] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.955782] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eda75f17-393d-4d95-8a9b-a7924138f446 is going to be created. [ 694.024044] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.024044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.024044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.024044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.024044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.041594] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eda75f17-393d-4d95-8a9b-a7924138f446 in Status: IN_PROGRESS for 2s [ 694.047033] env[70535]: INFO networking_nsxv3.common.synchronization [req-b631e19e-b183-4d23-8d58-c5df1a07fc0e req-8d3f65fa-52b1-4078-9950-0226e643acb6 tempest-ServerExternalEventsTest-1999822074 tempest-ServerExternalEventsTest-1999822074-project-member] Enqueued Resource ID: 56df97d7-88f0-451d-89de-62650bdc9016 with Priority: HIGHEST for action security_group_members [ 694.047033] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56df97d7-88f0-451d-89de-62650bdc9016 with Priority: HIGHEST for action security_group_members [ 694.047571] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-56df97d7-88f0-451d-89de-62650bdc9016 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.048129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.048885] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.048885] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.048885] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.050898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.050898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.050898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.050898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.050898] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56df97d7-88f0-451d-89de-62650bdc9016',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.188557] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.189354] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.189354] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.189562] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.189671] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.189780] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 is going to be created. [ 694.238928] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.238928] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.238928] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.238928] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.238928] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.258698] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: UNINITIALIZED for 2s [ 694.552439] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.552659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.552722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.552919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.553038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.553252] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.553381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.553437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.553589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.553671] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.553760] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56df97d7-88f0-451d-89de-62650bdc9016 already deleted. [ 694.553883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.015272] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.017777] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.017777] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.017777] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.017777] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.017777] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.017777] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.017777] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.018541] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.018541] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.018660] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.019537] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.019537] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.019537] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.019537] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.019537] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.101836] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.102603] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.083 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 695.102603] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.102603] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.102836] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-03ea48a0-04be-4a27-a8d6-7d910785f439 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.103079] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-03ea48a0-04be-4a27-a8d6-7d910785f439" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.103247] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-03ea48a0-04be-4a27-a8d6-7d910785f439" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.103650] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-03ea48a0-04be-4a27-a8d6-7d910785f439" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.103802] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03ea48a0-04be-4a27-a8d6-7d910785f439',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.506853] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb in Status: SUCCESS [ 695.506853] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb deletion is rescheduled due to dependency. [ 695.506853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.608575] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.609359] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.609773] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.610190] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.610406] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.610592] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 03ea48a0-04be-4a27-a8d6-7d910785f439 not found, creating... [ 695.610871] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.611055] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.611245] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.611592] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.611975] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.612434] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.612697] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.612838] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.613089] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.613245] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.613472] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 03ea48a0-04be-4a27-a8d6-7d910785f439 is going to be created. [ 695.641307] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.641748] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.641748] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.641970] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.642715] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.642715] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-03ea48a0-04be-4a27-a8d6-7d910785f439" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.875270] env[70535]: INFO networking_nsxv3.common.synchronization [None req-ea8eeb54-7773-44eb-be62-f66f351c4389 None None] Enqueued Resource ID: 28e1d98d-43a9-40a9-8780-d9d739cf8aa9 with Priority: HIGHEST for action port [ 695.876155] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28e1d98d-43a9-40a9-8780-d9d739cf8aa9 with Priority: HIGHEST for action port [ 695.876574] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-28e1d98d-43a9-40a9-8780-d9d739cf8aa9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.876637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28e1d98d-43a9-40a9-8780-d9d739cf8aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.876683] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28e1d98d-43a9-40a9-8780-d9d739cf8aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.877564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28e1d98d-43a9-40a9-8780-d9d739cf8aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.877564] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28e1d98d-43a9-40a9-8780-d9d739cf8aa9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.053128] env[70535]: INFO networking_nsxv3.common.synchronization [None req-702e1e35-3ff0-424c-b48f-ad0fbe7f44c2 None None] Enqueued Resource ID: 5084d2a1-eb41-473c-9306-5af1ea2d5740 with Priority: HIGHEST for action port [ 696.053684] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5084d2a1-eb41-473c-9306-5af1ea2d5740 with Priority: HIGHEST for action port [ 696.053997] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-5084d2a1-eb41-473c-9306-5af1ea2d5740 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.057578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5084d2a1-eb41-473c-9306-5af1ea2d5740" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.058201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5084d2a1-eb41-473c-9306-5af1ea2d5740" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.058201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5084d2a1-eb41-473c-9306-5af1ea2d5740" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.058201] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5084d2a1-eb41-473c-9306-5af1ea2d5740',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.063076] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eda75f17-393d-4d95-8a9b-a7924138f446 in Status: SUCCESS [ 696.063076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.277030] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: SUCCESS [ 696.277452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.277660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.278181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.278516] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.278737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.278737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.278830] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.278936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.279790] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.279949] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.382050] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28e1d98d-43a9-40a9-8780-d9d739cf8aa9 [ 696.382050] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.382050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.382050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.382050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.382050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.382050] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28e1d98d-43a9-40a9-8780-d9d739cf8aa9 already deleted. [ 696.388725] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28e1d98d-43a9-40a9-8780-d9d739cf8aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.540818] env[70535]: INFO networking_nsxv3.common.synchronization [req-f4747e7b-5769-4cc9-a479-bc0fd9aa851b req-38a4a4a0-205b-4e19-98cd-bea8e87fb7ad tempest-ListImageFiltersTestJSON-1844606616 tempest-ListImageFiltersTestJSON-1844606616-project-member] Enqueued Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_members [ 696.541646] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_members [ 696.549382] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.549382] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.549382] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.549382] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.549382] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.550118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.550118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.550275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.550346] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.550464] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.566930] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5084d2a1-eb41-473c-9306-5af1ea2d5740 [ 696.566930] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.567241] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.567241] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.567402] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.567518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.567694] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5084d2a1-eb41-473c-9306-5af1ea2d5740 already deleted. [ 696.567756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5084d2a1-eb41-473c-9306-5af1ea2d5740" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.707635] env[70535]: INFO networking_nsxv3.common.synchronization [req-b6d9bdc7-3a38-4acb-ae9a-14ee19993bdd req-c2903c53-08c2-4443-8806-0835aa29af49 tempest-ImagesNegativeTestJSON-1062958869 tempest-ImagesNegativeTestJSON-1062958869-project-member] Enqueued Resource ID: 5c0519b9-5948-4844-8e1d-20705cb47261 with Priority: HIGHEST for action security_group_members [ 696.707635] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c0519b9-5948-4844-8e1d-20705cb47261 with Priority: HIGHEST for action security_group_members [ 696.707635] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c0519b9-5948-4844-8e1d-20705cb47261 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.707635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.707635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.707635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.707635] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.707635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.707635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.707635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.709636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.709945] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c0519b9-5948-4844-8e1d-20705cb47261',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.785073] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.785073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.056464] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.183227] env[70535]: INFO networking_nsxv3.common.synchronization [req-b631e19e-b183-4d23-8d58-c5df1a07fc0e req-bfa049a1-a873-4bd8-8202-a99dacdd65ff service nova] Enqueued Resource ID: 56df97d7-88f0-451d-89de-62650bdc9016 with Priority: HIGHEST for action security_group_rules [ 697.183361] env[70535]: INFO networking_nsxv3.common.synchronization [req-b631e19e-b183-4d23-8d58-c5df1a07fc0e req-bfa049a1-a873-4bd8-8202-a99dacdd65ff service nova] Enqueued Resource ID: 56df97d7-88f0-451d-89de-62650bdc9016 with Priority: HIGHEST for action security_group_members [ 697.183480] env[70535]: INFO networking_nsxv3.common.synchronization [req-b631e19e-b183-4d23-8d58-c5df1a07fc0e req-bfa049a1-a873-4bd8-8202-a99dacdd65ff service nova] Enqueued Resource ID: 03ea48a0-04be-4a27-a8d6-7d910785f439 with Priority: HIGHEST for action port [ 697.185047] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56df97d7-88f0-451d-89de-62650bdc9016 with Priority: HIGHEST for action security_group_rules [ 697.185179] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56df97d7-88f0-451d-89de-62650bdc9016 with Priority: HIGHEST for action security_group_members [ 697.185564] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03ea48a0-04be-4a27-a8d6-7d910785f439 with Priority: HIGHEST for action port [ 697.186097] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56df97d7-88f0-451d-89de-62650bdc9016 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.186097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.186097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.186281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.186281] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56df97d7-88f0-451d-89de-62650bdc9016',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.187227] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-56df97d7-88f0-451d-89de-62650bdc9016 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.187352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.187422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.187596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.187746] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.188038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.188038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.188038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.188795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.189259] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56df97d7-88f0-451d-89de-62650bdc9016',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.193098] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-03ea48a0-04be-4a27-a8d6-7d910785f439 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.193265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03ea48a0-04be-4a27-a8d6-7d910785f439" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.193427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03ea48a0-04be-4a27-a8d6-7d910785f439" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.193667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03ea48a0-04be-4a27-a8d6-7d910785f439" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.193783] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03ea48a0-04be-4a27-a8d6-7d910785f439',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.216827] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.216997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.217071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.217268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.217354] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.217548] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.217638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.217731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.217850] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.218119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.218119] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c0519b9-5948-4844-8e1d-20705cb47261 is going to be updated. [ 697.335553] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.337214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.337214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.337214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.337214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.359807] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c0519b9-5948-4844-8e1d-20705cb47261 in Status: IN_PROGRESS for 2s [ 697.465167] env[70535]: INFO networking_nsxv3.common.synchronization [None req-9ca1a0ec-c74b-4d39-be0e-39c57835dcd1 tempest-ServersV294TestFqdnHostnames-734776706 tempest-ServersV294TestFqdnHostnames-734776706-project-member] Enqueued Resource ID: ce0ae195-bd66-418b-89e1-33b9dece1034 with Priority: HIGHEST for action security_group_rules [ 697.465565] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce0ae195-bd66-418b-89e1-33b9dece1034 with Priority: HIGHEST for action security_group_rules [ 697.466495] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce0ae195-bd66-418b-89e1-33b9dece1034 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.467468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.467468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.468084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.468496] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce0ae195-bd66-418b-89e1-33b9dece1034',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.563174] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.692165] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56df97d7-88f0-451d-89de-62650bdc9016',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.700691] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-56df97d7-88f0-451d-89de-62650bdc9016 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.700691] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.700691] env[70535]: INFO networking_nsxv3.common.synchronization [None req-c9757bd5-3437-4f98-9714-89d230feef76 None None] Enqueued Resource ID: ee000e96-cad5-446c-b602-7d9b338f4a61 with Priority: HIGHEST for action port [ 697.701365] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03ea48a0-04be-4a27-a8d6-7d910785f439 with status ACTIVE [ 697.701365] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.701514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.701514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.705237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.705237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.705237] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.705237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.705237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.705237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.705237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.705237] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.705237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.705237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.705237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.705237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.705237] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03ea48a0-04be-4a27-a8d6-7d910785f439 is going to be updated. [ 697.706745] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee000e96-cad5-446c-b602-7d9b338f4a61 with Priority: HIGHEST for action port [ 697.707116] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee000e96-cad5-446c-b602-7d9b338f4a61 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.707264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee000e96-cad5-446c-b602-7d9b338f4a61" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.708415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee000e96-cad5-446c-b602-7d9b338f4a61" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.709244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee000e96-cad5-446c-b602-7d9b338f4a61" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.709244] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee000e96-cad5-446c-b602-7d9b338f4a61',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.737777] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.737950] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.738076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.738265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.738426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.738592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03ea48a0-04be-4a27-a8d6-7d910785f439" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.788616] env[70535]: INFO networking_nsxv3.common.synchronization [None req-33579220-1e73-45f4-8e7f-298bed97b4b6 tempest-ServersV294TestFqdnHostnames-734776706 tempest-ServersV294TestFqdnHostnames-734776706-project-member] Enqueued Resource ID: ce0ae195-bd66-418b-89e1-33b9dece1034 with Priority: HIGHEST for action security_group_rules [ 697.788616] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce0ae195-bd66-418b-89e1-33b9dece1034 with Priority: HIGHEST for action security_group_rules [ 697.789246] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce0ae195-bd66-418b-89e1-33b9dece1034 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.789246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.000613] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.000613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.000731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.001913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.002099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.002226] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce0ae195-bd66-418b-89e1-33b9dece1034 already deleted. [ 698.002316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.002617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.002814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.002895] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce0ae195-bd66-418b-89e1-33b9dece1034',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.063678] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.064065] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.064065] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.064589] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.064877] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.065051] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.065166] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.065395] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.065570] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.065820] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.065937] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.066059] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.066181] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.066397] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.066506] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.066638] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.068195] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.068484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.068484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.068718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.068718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.068802] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 is going to be updated. [ 698.097108] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.097490] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 698.097603] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.097772] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.098213] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-70461e91-5dd7-48c5-b4f5-0c98cb7d1924 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.100023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-70461e91-5dd7-48c5-b4f5-0c98cb7d1924" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.100023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-70461e91-5dd7-48c5-b4f5-0c98cb7d1924" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.100023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-70461e91-5dd7-48c5-b4f5-0c98cb7d1924" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.100475] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70461e91-5dd7-48c5-b4f5-0c98cb7d1924',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.104088] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.104282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.104355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.104558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.104870] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.116588] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: IN_PROGRESS for 2s [ 698.199557] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56df97d7-88f0-451d-89de-62650bdc9016',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.216890] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee000e96-cad5-446c-b602-7d9b338f4a61 [ 698.217093] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.217235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.217345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.217526] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.217612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.217705] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee000e96-cad5-446c-b602-7d9b338f4a61 already deleted. [ 698.217783] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee000e96-cad5-446c-b602-7d9b338f4a61" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.529043] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.529043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.529043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.529043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.529043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.529043] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce0ae195-bd66-418b-89e1-33b9dece1034 already deleted. [ 698.529043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.603354] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.603354] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.603561] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.605023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.605023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.605023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 70461e91-5dd7-48c5-b4f5-0c98cb7d1924 not found, creating... [ 698.605023] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.605023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.605023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.605583] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.605583] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.605801] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.605953] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.606086] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.606302] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.606620] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.606785] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 70461e91-5dd7-48c5-b4f5-0c98cb7d1924 is going to be created. [ 698.629494] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.629810] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.629950] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.630266] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.630603] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.632551] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-70461e91-5dd7-48c5-b4f5-0c98cb7d1924" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.668324] env[70535]: INFO networking_nsxv3.common.synchronization [None req-c8b612b4-e80b-46f9-9a71-d4da81c9eb20 None None] Enqueued Resource ID: 4327b33b-d8cb-4595-9950-c8e951af388e with Priority: HIGHEST for action port [ 698.668324] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4327b33b-d8cb-4595-9950-c8e951af388e with Priority: HIGHEST for action port [ 698.668324] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-4327b33b-d8cb-4595-9950-c8e951af388e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.668324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4327b33b-d8cb-4595-9950-c8e951af388e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.668324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4327b33b-d8cb-4595-9950-c8e951af388e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.668899] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4327b33b-d8cb-4595-9950-c8e951af388e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.669100] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4327b33b-d8cb-4595-9950-c8e951af388e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.702596] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.702596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.702596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.702596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.702596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.702596] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56df97d7-88f0-451d-89de-62650bdc9016 is going to be created. [ 698.740514] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.740514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.740514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.742628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.742628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.754251] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56df97d7-88f0-451d-89de-62650bdc9016 in Status: UNINITIALIZED for 2s [ 699.172962] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4327b33b-d8cb-4595-9950-c8e951af388e [ 699.172962] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.172962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.172962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.172962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.172962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.172962] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4327b33b-d8cb-4595-9950-c8e951af388e already deleted. [ 699.172962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4327b33b-d8cb-4595-9950-c8e951af388e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.375881] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c0519b9-5948-4844-8e1d-20705cb47261 in Status: SUCCESS [ 699.376729] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c0519b9-5948-4844-8e1d-20705cb47261 deletion is rescheduled due to dependency. [ 699.378367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.670250] env[70535]: INFO networking_nsxv3.common.synchronization [req-7ce7bf49-335f-449d-8e8f-610c1fb66edf req-5a7868b9-8665-4461-8fa8-e240037278c0 tempest-DeleteServersAdminTestJSON-21744185 tempest-DeleteServersAdminTestJSON-21744185-project-member] Enqueued Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_members [ 699.670656] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_members [ 699.670969] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.671767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.671849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.672076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.672460] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.672460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.672460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.672592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.673323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.673323] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.132215] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: IN_PROGRESS for 4s [ 700.178633] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.178962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.178962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.179135] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.179801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.181772] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.181772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.181772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.181772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.181772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.181772] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 is going to be updated. [ 700.226283] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.226283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.226283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.226283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.226283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.238274] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 in Status: IN_PROGRESS for 2s [ 700.750021] env[70535]: INFO networking_nsxv3.common.synchronization [req-f4747e7b-5769-4cc9-a479-bc0fd9aa851b req-cdb1d3ab-1fa6-4ddf-ab41-64b0daf6bc31 service nova] Enqueued Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_rules [ 700.750021] env[70535]: INFO networking_nsxv3.common.synchronization [req-f4747e7b-5769-4cc9-a479-bc0fd9aa851b req-cdb1d3ab-1fa6-4ddf-ab41-64b0daf6bc31 service nova] Enqueued Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_members [ 700.750021] env[70535]: INFO networking_nsxv3.common.synchronization [req-f4747e7b-5769-4cc9-a479-bc0fd9aa851b req-cdb1d3ab-1fa6-4ddf-ab41-64b0daf6bc31 service nova] Enqueued Resource ID: 70461e91-5dd7-48c5-b4f5-0c98cb7d1924 with Priority: HIGHEST for action port [ 700.750021] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_rules [ 700.750021] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_members [ 700.750021] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70461e91-5dd7-48c5-b4f5-0c98cb7d1924 with Priority: HIGHEST for action port [ 700.750021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.750021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.750021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.750764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.750764] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-70461e91-5dd7-48c5-b4f5-0c98cb7d1924 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.750764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70461e91-5dd7-48c5-b4f5-0c98cb7d1924" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.751080] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70461e91-5dd7-48c5-b4f5-0c98cb7d1924" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.751608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70461e91-5dd7-48c5-b4f5-0c98cb7d1924" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.751608] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70461e91-5dd7-48c5-b4f5-0c98cb7d1924',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.767301] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56df97d7-88f0-451d-89de-62650bdc9016 in Status: SUCCESS [ 700.767301] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.767301] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.767558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.768074] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.768074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.768074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.768074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.768074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.768295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.768295] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56df97d7-88f0-451d-89de-62650bdc9016',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.937166] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.937166] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.937166] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.937166] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.939199] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.939550] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.943325] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.943325] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.943325] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.943325] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.943325] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.943325] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.943325] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.943325] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.943325] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.943325] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.965277] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.965518] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 700.965583] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.965756] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.966095] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-d8bb02b1-523d-4fc6-983c-85cfb38d5e40 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.966268] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-d8bb02b1-523d-4fc6-983c-85cfb38d5e40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.966382] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-d8bb02b1-523d-4fc6-983c-85cfb38d5e40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.966754] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-d8bb02b1-523d-4fc6-983c-85cfb38d5e40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.966895] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8bb02b1-523d-4fc6-983c-85cfb38d5e40',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.256545] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70461e91-5dd7-48c5-b4f5-0c98cb7d1924 with status ACTIVE [ 701.257813] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.257813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.257813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.257813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.257813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.257813] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.257813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.257813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.258259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.258259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.259322] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.259322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.259322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.259322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.259322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.259322] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70461e91-5dd7-48c5-b4f5-0c98cb7d1924 is going to be updated. [ 701.272622] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-56df97d7-88f0-451d-89de-62650bdc9016 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.272917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.273040] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.274785] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.275831] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.275831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.275831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.275831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.275831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.275831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.276214] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-56df97d7-88f0-451d-89de-62650bdc9016 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.276267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.276328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.276574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.276781] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.276927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.277043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.277155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.277236] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.277318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.277408] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56df97d7-88f0-451d-89de-62650bdc9016',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.304151] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.304151] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.304151] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.304151] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.304620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.304620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70461e91-5dd7-48c5-b4f5-0c98cb7d1924" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.470687] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.470928] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.471075] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.471360] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.471512] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.471667] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port d8bb02b1-523d-4fc6-983c-85cfb38d5e40 not found, creating... [ 701.471934] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.472109] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.472225] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.472478] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.472636] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.472936] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.473108] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.473229] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.473513] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.473579] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.473734] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: d8bb02b1-523d-4fc6-983c-85cfb38d5e40 is going to be created. [ 701.504948] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.504948] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.504948] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.505494] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.505494] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.505707] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-d8bb02b1-523d-4fc6-983c-85cfb38d5e40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.763245] env[70535]: INFO networking_nsxv3.common.synchronization [req-55d3b664-c946-4715-b022-8ace85cc808a req-6626de0a-68ac-478e-93f0-89fca64fa0b3 tempest-InstanceActionsV221TestJSON-1235496730 tempest-InstanceActionsV221TestJSON-1235496730-project-member] Enqueued Resource ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 with Priority: HIGHEST for action security_group_members [ 701.763245] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 with Priority: HIGHEST for action security_group_members [ 701.763245] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-29ee0426-6a12-4c04-9765-fa731a9837a7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.763735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.763984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.764358] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.765328] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.765605] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.765788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.766196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.766608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.766860] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29ee0426-6a12-4c04-9765-fa731a9837a7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.782149] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56df97d7-88f0-451d-89de-62650bdc9016: rpc.has_security_group_logging(os_id): False [ 701.804022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.804022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.804022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.804022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.804022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.804022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.804022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.804022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.804022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.804022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.804845] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.805119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.805302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.805564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.805756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.806067] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.809134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.809134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.809134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.809134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.809134] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56df97d7-88f0-451d-89de-62650bdc9016 is going to be created. [ 701.886023] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.886023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.886023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.886023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.886023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.898922] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56df97d7-88f0-451d-89de-62650bdc9016 in Status: IN_PROGRESS for 2s [ 702.143824] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: SUCCESS [ 702.144428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.144565] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.144782] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.145930] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.145930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.145930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.145930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.145930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.145930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.145930] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.145930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.145930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.146515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.147012] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.147012] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.147012] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.147012] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.147240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.147277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.147366] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.148278] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.148490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.148661] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.148792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.148874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.149066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.152382] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.152382] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.249949] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 in Status: SUCCESS [ 702.250348] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 deletion is rescheduled due to dependency. [ 702.250884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.269437] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.271284] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.271284] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.271284] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.271284] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.271284] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.271284] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.271284] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.271667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.271667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.271667] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 already deleted. [ 702.271783] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.493133] env[70535]: INFO networking_nsxv3.common.synchronization [None req-91cbd9c5-37a2-48cf-b3da-f699507b819a None None] Enqueued Resource ID: 57d5c38e-15a1-4b73-86aa-eac91debf0b2 with Priority: HIGHEST for action port [ 702.493377] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57d5c38e-15a1-4b73-86aa-eac91debf0b2 with Priority: HIGHEST for action port [ 702.493983] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-57d5c38e-15a1-4b73-86aa-eac91debf0b2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.494368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57d5c38e-15a1-4b73-86aa-eac91debf0b2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.494532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57d5c38e-15a1-4b73-86aa-eac91debf0b2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.494975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57d5c38e-15a1-4b73-86aa-eac91debf0b2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.495645] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57d5c38e-15a1-4b73-86aa-eac91debf0b2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.651322] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9bfef491-cf1d-478b-8711-9cea38aaf832: rpc.has_security_group_logging(os_id): False [ 702.654805] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.682933] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.682933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.682933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.682933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.682933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.682933] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.682933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.682933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.682933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.682933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.682933] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.682933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.682933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.682933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.682933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.684797] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.684797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.684797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.684797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.684797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.684797] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 is going to be created. [ 702.756610] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.756610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.756610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.756894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.757213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.775691] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: IN_PROGRESS for 2s [ 702.998892] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57d5c38e-15a1-4b73-86aa-eac91debf0b2 [ 702.998892] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.999034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.000106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.000106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.000106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.000106] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57d5c38e-15a1-4b73-86aa-eac91debf0b2 already deleted. [ 703.000106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57d5c38e-15a1-4b73-86aa-eac91debf0b2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.025022] env[70535]: INFO networking_nsxv3.common.synchronization [req-7ce7bf49-335f-449d-8e8f-610c1fb66edf req-3f6bbdc7-cc8f-465c-b0d2-abb2e6579939 service nova] Enqueued Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_rules [ 703.025022] env[70535]: INFO networking_nsxv3.common.synchronization [req-7ce7bf49-335f-449d-8e8f-610c1fb66edf req-3f6bbdc7-cc8f-465c-b0d2-abb2e6579939 service nova] Enqueued Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_members [ 703.025022] env[70535]: INFO networking_nsxv3.common.synchronization [req-7ce7bf49-335f-449d-8e8f-610c1fb66edf req-3f6bbdc7-cc8f-465c-b0d2-abb2e6579939 service nova] Enqueued Resource ID: d8bb02b1-523d-4fc6-983c-85cfb38d5e40 with Priority: HIGHEST for action port [ 703.025022] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_rules [ 703.025022] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_members [ 703.025022] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8bb02b1-523d-4fc6-983c-85cfb38d5e40 with Priority: HIGHEST for action port [ 703.025022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.025022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.025022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.025512] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.025512] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.026078] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.026200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.026267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.026509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.026686] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.026829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.026907] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.027100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.027192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.027528] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.028096] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8bb02b1-523d-4fc6-983c-85cfb38d5e40 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.028201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8bb02b1-523d-4fc6-983c-85cfb38d5e40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.028358] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8bb02b1-523d-4fc6-983c-85cfb38d5e40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.028423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8bb02b1-523d-4fc6-983c-85cfb38d5e40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.028602] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8bb02b1-523d-4fc6-983c-85cfb38d5e40',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.157144] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.183501] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-544 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.183713] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.184467] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.184467] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.184467] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.184797] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.184797] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.185130] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.193237] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.193237] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.193237] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.193237] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.193237] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.193237] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.193237] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.193237] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.215342] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.215342] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 703.215714] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.215714] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.219427] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-e56ac885-e3c4-4e4f-bffd-e67a1be360d0 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.219427] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-e56ac885-e3c4-4e4f-bffd-e67a1be360d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.219427] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-e56ac885-e3c4-4e4f-bffd-e67a1be360d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.219607] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-e56ac885-e3c4-4e4f-bffd-e67a1be360d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.219643] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e56ac885-e3c4-4e4f-bffd-e67a1be360d0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.530194] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.530494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.530586] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.531555] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8bb02b1-523d-4fc6-983c-85cfb38d5e40 with status ACTIVE [ 703.531774] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.531932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.532042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.532272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.532397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.533470] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.533608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.533705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.533916] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.534035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.534269] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.534398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.534476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.534654] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.534754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.535806] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8bb02b1-523d-4fc6-983c-85cfb38d5e40 is going to be updated. [ 703.559902] env[70535]: INFO networking_nsxv3.common.synchronization [None req-b84a8a83-2df0-49aa-98ff-847dfdb1579e None None] Enqueued Resource ID: 36604d42-8338-4fdc-b97b-cd4c8df83a18 with Priority: HIGHEST for action port [ 703.564705] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.564705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.564705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.564705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.564705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.564705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8bb02b1-523d-4fc6-983c-85cfb38d5e40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.564705] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36604d42-8338-4fdc-b97b-cd4c8df83a18 with Priority: HIGHEST for action port [ 703.564705] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-36604d42-8338-4fdc-b97b-cd4c8df83a18 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.564705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36604d42-8338-4fdc-b97b-cd4c8df83a18" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.564705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36604d42-8338-4fdc-b97b-cd4c8df83a18" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.564705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36604d42-8338-4fdc-b97b-cd4c8df83a18" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.564705] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36604d42-8338-4fdc-b97b-cd4c8df83a18',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.661563] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.661821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.661821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.662029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.662254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.662254] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 is going to be updated. [ 703.704589] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.704740] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.705021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.705641] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.705753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.718049] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: IN_PROGRESS for 2s [ 703.722160] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.722390] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.722549] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.722839] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.722991] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.723200] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port e56ac885-e3c4-4e4f-bffd-e67a1be360d0 not found, creating... [ 703.723443] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.723627] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.723747] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.723978] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.726113] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.726113] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.726113] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.726113] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.726113] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.729204] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.729712] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: e56ac885-e3c4-4e4f-bffd-e67a1be360d0 is going to be created. [ 703.760959] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.761207] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.761331] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.761610] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.761902] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.762117] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-e56ac885-e3c4-4e4f-bffd-e67a1be360d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.858260] env[70535]: INFO networking_nsxv3.common.synchronization [None req-5d84c25a-b1ae-46d0-8be5-efbc77c9a018 None None] Enqueued Resource ID: 3a7cc58d-11a9-4084-b5e4-7732533898a5 with Priority: HIGHEST for action port [ 703.858380] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7cc58d-11a9-4084-b5e4-7732533898a5 with Priority: HIGHEST for action port [ 703.858875] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a7cc58d-11a9-4084-b5e4-7732533898a5 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.859012] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a7cc58d-11a9-4084-b5e4-7732533898a5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.859074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a7cc58d-11a9-4084-b5e4-7732533898a5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.860079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a7cc58d-11a9-4084-b5e4-7732533898a5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.860079] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a7cc58d-11a9-4084-b5e4-7732533898a5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.914692] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56df97d7-88f0-451d-89de-62650bdc9016 in Status: SUCCESS [ 703.914818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.038620] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.072107] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36604d42-8338-4fdc-b97b-cd4c8df83a18 [ 704.072107] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.072107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.072107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.072107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.072107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.072107] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36604d42-8338-4fdc-b97b-cd4c8df83a18 already deleted. [ 704.072107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36604d42-8338-4fdc-b97b-cd4c8df83a18" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.334529] env[70535]: INFO networking_nsxv3.common.synchronization [req-98298bf3-da7f-436c-aefb-975497f482a5 req-0b18aaca-7494-4952-bbd8-452c34c64752 tempest-FloatingIPsAssociationNegativeTestJSON-584374596 tempest-FloatingIPsAssociationNegativeTestJSON-584374596-project-member] Enqueued Resource ID: ec60a8db-faf5-42bd-94a8-662a5418627b with Priority: HIGHEST for action security_group_members [ 704.336528] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec60a8db-faf5-42bd-94a8-662a5418627b with Priority: HIGHEST for action security_group_members [ 704.337033] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec60a8db-faf5-42bd-94a8-662a5418627b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.337207] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.337372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.341028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.341028] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.341028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.341028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.341028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.341028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.341028] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec60a8db-faf5-42bd-94a8-662a5418627b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.362697] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a7cc58d-11a9-4084-b5e4-7732533898a5 [ 704.362697] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.362697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.362697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.362697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.362697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.362697] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a7cc58d-11a9-4084-b5e4-7732533898a5 already deleted. [ 704.362697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a7cc58d-11a9-4084-b5e4-7732533898a5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.543477] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.543853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.543853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.543853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.543989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.543989] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 is going to be updated. [ 704.579851] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.580009] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.580349] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.580349] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.580656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.591260] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 in Status: IN_PROGRESS for 2s [ 704.665201] env[70535]: INFO networking_nsxv3.common.synchronization [None req-ef04ca57-ed67-4c8e-ac58-d79cafc8c353 None None] Enqueued Resource ID: da3bd801-18dd-4cfb-8f8e-b9760ff05d5a with Priority: HIGHEST for action port [ 704.665201] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da3bd801-18dd-4cfb-8f8e-b9760ff05d5a with Priority: HIGHEST for action port [ 704.667202] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-da3bd801-18dd-4cfb-8f8e-b9760ff05d5a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.667202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da3bd801-18dd-4cfb-8f8e-b9760ff05d5a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.667202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da3bd801-18dd-4cfb-8f8e-b9760ff05d5a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.667202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da3bd801-18dd-4cfb-8f8e-b9760ff05d5a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.667202] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da3bd801-18dd-4cfb-8f8e-b9760ff05d5a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.794435] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: SUCCESS [ 704.794435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.794435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.794435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.794435] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.842121] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.842288] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.842372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.842621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.842707] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.842931] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.843048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.843093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.843249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.843323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.843412] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec60a8db-faf5-42bd-94a8-662a5418627b already deleted. [ 704.843493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.171468] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da3bd801-18dd-4cfb-8f8e-b9760ff05d5a [ 705.171468] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.171468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.171468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.171468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.171468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.171468] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da3bd801-18dd-4cfb-8f8e-b9760ff05d5a already deleted. [ 705.171468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da3bd801-18dd-4cfb-8f8e-b9760ff05d5a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.297223] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.297223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.358349] env[70535]: INFO networking_nsxv3.common.synchronization [None req-12bb47d4-e3fc-494f-8494-fdd9ce177b76 tempest-ServerActionsV293TestJSON-1453434710 tempest-ServerActionsV293TestJSON-1453434710-project-member] Enqueued Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGHEST for action security_group_rules [ 705.359691] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGHEST for action security_group_rules [ 705.360076] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.360267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.360313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.360619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.360706] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9244c40-b3c3-42a1-af4b-33b8585c25ed',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.502214] env[70535]: INFO networking_nsxv3.common.synchronization [req-55d3b664-c946-4715-b022-8ace85cc808a req-73a97d5f-371a-4156-8b19-93ac912cbb92 service nova] Enqueued Resource ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 with Priority: HIGHEST for action security_group_rules [ 705.502383] env[70535]: INFO networking_nsxv3.common.synchronization [req-55d3b664-c946-4715-b022-8ace85cc808a req-73a97d5f-371a-4156-8b19-93ac912cbb92 service nova] Enqueued Resource ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 with Priority: HIGHEST for action security_group_members [ 705.502565] env[70535]: INFO networking_nsxv3.common.synchronization [req-55d3b664-c946-4715-b022-8ace85cc808a req-73a97d5f-371a-4156-8b19-93ac912cbb92 service nova] Enqueued Resource ID: e56ac885-e3c4-4e4f-bffd-e67a1be360d0 with Priority: HIGHEST for action port [ 705.505208] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 with Priority: HIGHEST for action security_group_rules [ 705.505586] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 with Priority: HIGHEST for action security_group_members [ 705.505701] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56ac885-e3c4-4e4f-bffd-e67a1be360d0 with Priority: HIGHEST for action port [ 705.506344] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29ee0426-6a12-4c04-9765-fa731a9837a7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.506487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.506538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.506868] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.506928] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29ee0426-6a12-4c04-9765-fa731a9837a7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.508189] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-29ee0426-6a12-4c04-9765-fa731a9837a7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.508311] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.508379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.508575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.508731] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.508864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.508961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.510865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.510959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.511085] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29ee0426-6a12-4c04-9765-fa731a9837a7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.512089] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-e56ac885-e3c4-4e4f-bffd-e67a1be360d0 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.512248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e56ac885-e3c4-4e4f-bffd-e67a1be360d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.512248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e56ac885-e3c4-4e4f-bffd-e67a1be360d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.512366] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e56ac885-e3c4-4e4f-bffd-e67a1be360d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.512417] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e56ac885-e3c4-4e4f-bffd-e67a1be360d0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.730030] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: SUCCESS [ 705.730314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.731200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.731200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.731200] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.731200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.731200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.732422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.732422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.732422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.732422] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.734884] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-298 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.735123] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-298" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.735336] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-298" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.735681] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-298" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.735950] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.739036] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.739036] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.739036] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.739036] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.739036] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.739036] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.739036] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.739036] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.739036] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.739036] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.739036] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.761655] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.761655] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 705.761655] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.761655] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-298" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.761655] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-92d07731-ce3b-4c39-b185-137c8b7fc455 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.763043] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-92d07731-ce3b-4c39-b185-137c8b7fc455" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.763043] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-92d07731-ce3b-4c39-b185-137c8b7fc455" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.763043] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-92d07731-ce3b-4c39-b185-137c8b7fc455" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.763043] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92d07731-ce3b-4c39-b185-137c8b7fc455',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.898624] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.899649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.899649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.900537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.900537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.900537] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed already deleted. [ 705.900819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.014206] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-29ee0426-6a12-4c04-9765-fa731a9837a7 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.014524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.016894] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29ee0426-6a12-4c04-9765-fa731a9837a7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.018582] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e56ac885-e3c4-4e4f-bffd-e67a1be360d0 with status ACTIVE [ 706.018714] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.019114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.019474] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.019864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.020095] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.020477] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.020703] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.020971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.021302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.021470] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.022123] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.022123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.022309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.025032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.025032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.025032] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e56ac885-e3c4-4e4f-bffd-e67a1be360d0 is going to be updated. [ 706.055971] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.056306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.056306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.056496] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.056612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.059076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e56ac885-e3c4-4e4f-bffd-e67a1be360d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.176252] env[70535]: INFO networking_nsxv3.common.synchronization [None req-818ea471-0052-48a7-9a3f-58a3821d9fd5 tempest-ServerActionsV293TestJSON-1453434710 tempest-ServerActionsV293TestJSON-1453434710-project-member] Enqueued Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGHEST for action security_group_rules [ 706.176616] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGHEST for action security_group_rules [ 706.177122] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.177347] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.177478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.178688] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.178688] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9244c40-b3c3-42a1-af4b-33b8585c25ed',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.242757] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.242757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.242966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.243551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.243551] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.243551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.243551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.243551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.243861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.243861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.243932] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.244929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.244929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.244929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.244929] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.244929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.244929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.244929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.244929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.244929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.244929] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.266442] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.266442] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.266442] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.266442] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.266442] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.266442] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 92d07731-ce3b-4c39-b185-137c8b7fc455 not found, creating... [ 706.266765] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.267826] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.267826] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.267826] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.267826] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.269364] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.269364] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.269364] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.269364] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.269616] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.270760] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 92d07731-ce3b-4c39-b185-137c8b7fc455 is going to be created. [ 706.308118] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.308118] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.308118] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.308391] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.308857] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.309132] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-92d07731-ce3b-4c39-b185-137c8b7fc455" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.523039] env[70535]: INFO networking_nsxv3.common.synchronization [req-03cad353-3ee0-4a0b-a21a-5ca499a544f5 req-183d6e2e-00c2-4995-b309-f0b8c6e69cf8 tempest-ServerPasswordTestJSON-1888714512 tempest-ServerPasswordTestJSON-1888714512-project-member] Enqueued Resource ID: eda75f17-393d-4d95-8a9b-a7924138f446 with Priority: HIGHEST for action security_group_members [ 706.524510] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda75f17-393d-4d95-8a9b-a7924138f446 with Priority: HIGHEST for action security_group_members [ 706.525826] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda75f17-393d-4d95-8a9b-a7924138f446 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.525826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.525826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.525826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.525826] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.525826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.525826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.526312] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.526312] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.526312] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eda75f17-393d-4d95-8a9b-a7924138f446',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.531736] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29ee0426-6a12-4c04-9765-fa731a9837a7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.604328] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 in Status: SUCCESS [ 706.604328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.604328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.605520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.605520] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.605520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.605520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.605520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.605520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.605976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.605976] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.703926] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.704097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.704164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.704449] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.704624] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.704707] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed already deleted. [ 706.704801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.749764] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9bfef491-cf1d-478b-8711-9cea38aaf832: rpc.has_security_group_logging(os_id): False [ 706.771637] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.771637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.771637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.771637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.771637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.771637] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.771637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.771637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.772141] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.774262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.774262] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.774262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.774262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.774262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.774262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.774262] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.774262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.774262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.774262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.774262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.774262] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 is going to be updated. [ 706.855084] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.855247] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.855325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.856151] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.856308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.873655] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: IN_PROGRESS for 2s [ 707.034379] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.034379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.034379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.034379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.034379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.034379] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.034379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.034379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.034379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.034379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.034379] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eda75f17-393d-4d95-8a9b-a7924138f446 is going to be updated. [ 707.035400] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.035523] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.035589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.035728] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.035804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.037988] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 is going to be created. [ 707.084316] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.084478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.084585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.087503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.087503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.095841] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.095841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.096215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.096215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.096346] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.099967] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 in Status: UNINITIALIZED for 2s [ 707.108091] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.108716] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.108856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.109208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.109479] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.109654] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.109654] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.109797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.109907] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.110023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.110302] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.110302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.110788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.110788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.110880] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.111044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.111106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.111269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.111365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.111456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.111586] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.114600] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda75f17-393d-4d95-8a9b-a7924138f446 in Status: IN_PROGRESS for 2s [ 707.617881] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbb53f03-8f48-4baa-b4e6-67243ad60187: rpc.has_security_group_logging(os_id): False [ 707.642046] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.642046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.642046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.642046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.642046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.642046] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.642046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.642046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.642046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.642046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.642046] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.642046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.642046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.642046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.642046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.642999] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.642999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.642999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.642999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.642999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.642999] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 is going to be updated. [ 707.656276] env[70535]: INFO networking_nsxv3.common.synchronization [None req-8eaa39b0-2906-476e-98c6-f60c8dc6775f None None] Enqueued Resource ID: bc310fc4-c9d2-4f92-b73f-9fe7601a67d1 with Priority: HIGHEST for action port [ 707.656579] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc310fc4-c9d2-4f92-b73f-9fe7601a67d1 with Priority: HIGHEST for action port [ 707.657250] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc310fc4-c9d2-4f92-b73f-9fe7601a67d1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.657393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc310fc4-c9d2-4f92-b73f-9fe7601a67d1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.657445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc310fc4-c9d2-4f92-b73f-9fe7601a67d1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.657702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc310fc4-c9d2-4f92-b73f-9fe7601a67d1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.657829] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc310fc4-c9d2-4f92-b73f-9fe7601a67d1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.733289] env[70535]: INFO networking_nsxv3.common.synchronization [req-9bc0ea56-d8db-4a31-98a4-d45446c61757 req-b7e5101b-876a-4168-9ba1-630217366476 tempest-ServerDiskConfigTestJSON-1021082095 tempest-ServerDiskConfigTestJSON-1021082095-project-member] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 707.735990] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 707.736364] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.736698] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.736698] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.736801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.736921] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.737115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.737115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.737294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.737431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.737482] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.740050] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.740240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.740240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.740430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.740589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.757899] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 in Status: IN_PROGRESS for 2s [ 707.951740] env[70535]: INFO networking_nsxv3.common.synchronization [None req-b60c263b-44f4-4718-a22a-9183b770e4bf None None] Enqueued Resource ID: 42f89eef-fdbb-4158-a191-af18f5d50b8f with Priority: HIGHEST for action port [ 707.953630] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42f89eef-fdbb-4158-a191-af18f5d50b8f with Priority: HIGHEST for action port [ 707.954025] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-42f89eef-fdbb-4158-a191-af18f5d50b8f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.954296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42f89eef-fdbb-4158-a191-af18f5d50b8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.954296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42f89eef-fdbb-4158-a191-af18f5d50b8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.954606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42f89eef-fdbb-4158-a191-af18f5d50b8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.954718] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42f89eef-fdbb-4158-a191-af18f5d50b8f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.075553] env[70535]: INFO networking_nsxv3.common.synchronization [req-98298bf3-da7f-436c-aefb-975497f482a5 req-5c600bd3-d58d-4bb4-a4ce-ad1306871f52 service nova] Enqueued Resource ID: ec60a8db-faf5-42bd-94a8-662a5418627b with Priority: HIGHEST for action security_group_rules [ 708.075553] env[70535]: INFO networking_nsxv3.common.synchronization [req-98298bf3-da7f-436c-aefb-975497f482a5 req-5c600bd3-d58d-4bb4-a4ce-ad1306871f52 service nova] Enqueued Resource ID: ec60a8db-faf5-42bd-94a8-662a5418627b with Priority: HIGHEST for action security_group_members [ 708.075553] env[70535]: INFO networking_nsxv3.common.synchronization [req-98298bf3-da7f-436c-aefb-975497f482a5 req-5c600bd3-d58d-4bb4-a4ce-ad1306871f52 service nova] Enqueued Resource ID: 92d07731-ce3b-4c39-b185-137c8b7fc455 with Priority: HIGHEST for action port [ 708.075553] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec60a8db-faf5-42bd-94a8-662a5418627b with Priority: HIGHEST for action security_group_rules [ 708.077896] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec60a8db-faf5-42bd-94a8-662a5418627b with Priority: HIGHEST for action security_group_members [ 708.077896] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92d07731-ce3b-4c39-b185-137c8b7fc455 with Priority: HIGHEST for action port [ 708.077896] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec60a8db-faf5-42bd-94a8-662a5418627b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.077896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.077896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.077896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.077896] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec60a8db-faf5-42bd-94a8-662a5418627b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.078593] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec60a8db-faf5-42bd-94a8-662a5418627b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.078593] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.078593] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.078862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.079160] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.079270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.079330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.079547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.079634] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.079724] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec60a8db-faf5-42bd-94a8-662a5418627b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.080719] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-92d07731-ce3b-4c39-b185-137c8b7fc455 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.080843] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92d07731-ce3b-4c39-b185-137c8b7fc455" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.080902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92d07731-ce3b-4c39-b185-137c8b7fc455" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.081134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92d07731-ce3b-4c39-b185-137c8b7fc455" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.081220] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92d07731-ce3b-4c39-b185-137c8b7fc455',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.161304] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc310fc4-c9d2-4f92-b73f-9fe7601a67d1 [ 708.161934] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.161934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.161934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.163592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.163592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.163592] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc310fc4-c9d2-4f92-b73f-9fe7601a67d1 already deleted. [ 708.163592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc310fc4-c9d2-4f92-b73f-9fe7601a67d1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.239897] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.240099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.240224] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.240564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.240564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.240745] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.240860] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.240963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.242265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.242265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.242265] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 708.278437] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.278637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.278715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.278947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.279199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.291563] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 708.458677] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42f89eef-fdbb-4158-a191-af18f5d50b8f [ 708.458909] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.459168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.459240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.459481] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.459902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.460103] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42f89eef-fdbb-4158-a191-af18f5d50b8f already deleted. [ 708.460226] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42f89eef-fdbb-4158-a191-af18f5d50b8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.525664] env[70535]: INFO networking_nsxv3.common.synchronization [None req-6926d182-c561-40e7-a090-183e8371e637 tempest-AttachVolumeShelveTestJSON-2125264447 tempest-AttachVolumeShelveTestJSON-2125264447-project-member] Enqueued Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_rules [ 708.527493] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_rules [ 708.527493] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c30db4ac-0243-4260-914e-2e6a0283c93a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.528335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.528459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.528788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.528788] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.586549] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec60a8db-faf5-42bd-94a8-662a5418627b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.587593] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec60a8db-faf5-42bd-94a8-662a5418627b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.587735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.587893] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92d07731-ce3b-4c39-b185-137c8b7fc455 with status ACTIVE [ 708.588670] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.588670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.588670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.588670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.588670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.588971] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.588971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.588971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.589336] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.589336] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.589467] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.589534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.589608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.589736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.589808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.589993] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92d07731-ce3b-4c39-b185-137c8b7fc455 is going to be updated. [ 708.618871] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.619031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.619031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.621739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.621739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.621739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92d07731-ce3b-4c39-b185-137c8b7fc455" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.839854] env[70535]: INFO networking_nsxv3.common.synchronization [None req-8b8c3787-1451-467e-b519-7bb4d543938c tempest-AttachVolumeShelveTestJSON-2125264447 tempest-AttachVolumeShelveTestJSON-2125264447-project-member] Enqueued Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_rules [ 708.839854] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_rules [ 708.839854] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c30db4ac-0243-4260-914e-2e6a0283c93a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.839854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.883213] env[70535]: INFO networking_nsxv3.common.synchronization [req-96cfccb5-70b8-4e73-9758-ad77a794f645 req-03b14032-9f5d-4632-a4b9-e068ca9e5a7a tempest-ServerActionsTestJSON-1674828100 tempest-ServerActionsTestJSON-1674828100-project-member] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 708.883213] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 708.883213] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.883213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.883213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.883213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.883213] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.883213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.883213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.884107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.884344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.884541] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.893200] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: SUCCESS [ 708.893200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.058333] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.058497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.058553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.059427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.059427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.059427] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c30db4ac-0243-4260-914e-2e6a0283c93a already deleted. [ 709.059427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.059427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.059427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.059427] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.094181] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec60a8db-faf5-42bd-94a8-662a5418627b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.110564] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 in Status: SUCCESS [ 709.110887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.111161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.111436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.112104] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.112274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.112345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.112577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.112670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.112762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.113244] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29ee0426-6a12-4c04-9765-fa731a9837a7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.125428] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda75f17-393d-4d95-8a9b-a7924138f446 in Status: SUCCESS [ 709.126144] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eda75f17-393d-4d95-8a9b-a7924138f446 deletion is rescheduled due to dependency. [ 709.126144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.176251] env[70535]: INFO networking_nsxv3.common.synchronization [None req-bd8b5475-90a7-4836-beb1-0561c7ed5dcb tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 with Priority: HIGHEST for action security_group_rules [ 709.177225] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 with Priority: HIGHEST for action security_group_rules [ 709.177550] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.177738] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.177787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.178150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.178206] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48008d9c-bbf6-40a2-bb47-24eddd9f74c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.389818] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.390029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.390029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.390256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.390334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.391509] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.391509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.391509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.391509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.391509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.391509] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 already deleted. [ 709.391509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.584575] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.584778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.584873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.585188] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.585284] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.585381] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c30db4ac-0243-4260-914e-2e6a0283c93a already deleted. [ 709.585465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.597597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.597750] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.597795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.599214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.599214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.599214] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec60a8db-faf5-42bd-94a8-662a5418627b is going to be created. [ 709.609646] env[70535]: INFO networking_nsxv3.common.synchronization [None req-2a93a5f7-40ef-4e87-87e4-2ca140d11ffa tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 with Priority: HIGHEST for action security_group_rules [ 709.610386] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 with Priority: HIGHEST for action security_group_rules [ 709.614524] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.614664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.615824] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-29ee0426-6a12-4c04-9765-fa731a9837a7 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.615976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.616041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.616269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.616422] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.616529] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.616588] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.616745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.616853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.616942] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.617101] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-29ee0426-6a12-4c04-9765-fa731a9837a7 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.617228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.617306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.617456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.617593] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.617699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.617769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.617936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.619662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.619809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.619905] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29ee0426-6a12-4c04-9765-fa731a9837a7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.625701] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.625881] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.625932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.626120] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.626571] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.644029] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec60a8db-faf5-42bd-94a8-662a5418627b in Status: UNINITIALIZED for 2s [ 709.706277] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.706277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.706277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.706277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.706277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.706277] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 already deleted. [ 709.706277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.706277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.706277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.706277] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48008d9c-bbf6-40a2-bb47-24eddd9f74c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.772376] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 in Status: SUCCESS [ 709.772488] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.125229] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29ee0426-6a12-4c04-9765-fa731a9837a7: rpc.has_security_group_logging(os_id): False [ 710.143356] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.143973] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.144379] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.145064] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.145533] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.145699] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.145826] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.146189] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.146544] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.146894] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 710.147095] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.147280] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.147433] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.147578] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 710.147911] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.148531] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.153867] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.153867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.153867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.153867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.153867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.153867] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.153867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.153867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.153867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.153867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.153867] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.153867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.153867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.153867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.153867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.154861] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.154861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.154861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.154861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.154861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.154861] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 is going to be created. [ 710.207026] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.207026] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.057 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 710.207026] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.207026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.207026] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-d852207d-5092-40c0-bc22-bf8cf0710530 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.207026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-d852207d-5092-40c0-bc22-bf8cf0710530" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.207026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-d852207d-5092-40c0-bc22-bf8cf0710530" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.207026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-d852207d-5092-40c0-bc22-bf8cf0710530" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.209013] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d852207d-5092-40c0-bc22-bf8cf0710530',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.260786] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.260786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.260786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.260786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.260786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.260786] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 already deleted. [ 710.260786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.310519] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 710.310519] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 deletion is rescheduled due to dependency. [ 710.310519] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.312822] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.312822] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.313193] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.313193] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.313398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.330212] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 in Status: IN_PROGRESS for 2s [ 710.713456] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.713456] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.713456] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.713854] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.713854] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.714035] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port d852207d-5092-40c0-bc22-bf8cf0710530 not found, creating... [ 710.714337] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.714527] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.714674] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.715764] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.716029] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.718159] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.718159] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.718159] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.718159] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.718159] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.718159] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: d852207d-5092-40c0-bc22-bf8cf0710530 is going to be created. [ 710.745286] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.745550] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.745679] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.745965] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.746252] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.747469] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-d852207d-5092-40c0-bc22-bf8cf0710530" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.658606] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec60a8db-faf5-42bd-94a8-662a5418627b in Status: SUCCESS [ 711.658606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.658606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.658606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.658606] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.658606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.658606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.658606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.658606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.658606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.659472] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec60a8db-faf5-42bd-94a8-662a5418627b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.921953] env[70535]: INFO networking_nsxv3.common.synchronization [None req-b8e7df24-07be-44ff-9ec1-e04411710c9b None None] Enqueued Resource ID: 59db82b7-50c1-4220-9a83-34d66a76b9db with Priority: HIGHEST for action port [ 711.922778] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59db82b7-50c1-4220-9a83-34d66a76b9db with Priority: HIGHEST for action port [ 711.923088] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-59db82b7-50c1-4220-9a83-34d66a76b9db taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.923088] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59db82b7-50c1-4220-9a83-34d66a76b9db" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.923179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59db82b7-50c1-4220-9a83-34d66a76b9db" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.923422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59db82b7-50c1-4220-9a83-34d66a76b9db" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.924141] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59db82b7-50c1-4220-9a83-34d66a76b9db',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.164564] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec60a8db-faf5-42bd-94a8-662a5418627b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.164784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.165414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.165748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.166614] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.166614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.166614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.166614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.166895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.166895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.166997] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec60a8db-faf5-42bd-94a8-662a5418627b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.167102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.167102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.167267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.167412] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.167510] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.167594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.167753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.167834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.167919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.173116] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec60a8db-faf5-42bd-94a8-662a5418627b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.329402] env[70535]: INFO networking_nsxv3.common.synchronization [req-96cfccb5-70b8-4e73-9758-ad77a794f645 req-6272fc05-98a9-409b-8a96-e310723d785a service nova] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_rules [ 712.329402] env[70535]: INFO networking_nsxv3.common.synchronization [req-96cfccb5-70b8-4e73-9758-ad77a794f645 req-6272fc05-98a9-409b-8a96-e310723d785a service nova] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 712.329402] env[70535]: INFO networking_nsxv3.common.synchronization [req-96cfccb5-70b8-4e73-9758-ad77a794f645 req-6272fc05-98a9-409b-8a96-e310723d785a service nova] Enqueued Resource ID: d852207d-5092-40c0-bc22-bf8cf0710530 with Priority: HIGHEST for action port [ 712.329402] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_rules [ 712.329832] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 712.329832] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d852207d-5092-40c0-bc22-bf8cf0710530 with Priority: HIGHEST for action port [ 712.330164] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.331155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.331155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.331155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.331155] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.333186] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.333186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.333186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.333186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.333186] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.333525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.333722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.333971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.334131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.334274] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.335571] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-d852207d-5092-40c0-bc22-bf8cf0710530 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.335732] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d852207d-5092-40c0-bc22-bf8cf0710530" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.335830] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d852207d-5092-40c0-bc22-bf8cf0710530" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.336096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d852207d-5092-40c0-bc22-bf8cf0710530" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.337283] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d852207d-5092-40c0-bc22-bf8cf0710530',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.358164] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 in Status: SUCCESS [ 712.358518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.431437] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59db82b7-50c1-4220-9a83-34d66a76b9db [ 712.431684] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.431829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.431896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.432177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.432273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.432373] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59db82b7-50c1-4220-9a83-34d66a76b9db already deleted. [ 712.432454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59db82b7-50c1-4220-9a83-34d66a76b9db" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.675432] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec60a8db-faf5-42bd-94a8-662a5418627b: rpc.has_security_group_logging(os_id): False [ 712.701647] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.701863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.701955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.702245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.702383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.702735] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.702886] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.702959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.703575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.703815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.705499] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.705499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.705499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.705499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.705499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.705499] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.705499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.705499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.705499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.705499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.705499] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec60a8db-faf5-42bd-94a8-662a5418627b is going to be created. [ 712.788221] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.788221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.788221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.788532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.791687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.807447] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec60a8db-faf5-42bd-94a8-662a5418627b in Status: IN_PROGRESS for 2s [ 712.847216] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d852207d-5092-40c0-bc22-bf8cf0710530 with status ACTIVE [ 712.847216] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.847216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.847216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.847216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.847216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.847216] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.847216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.847216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.847216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.847216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.847216] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.847216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.847216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.847216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.847216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.847216] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d852207d-5092-40c0-bc22-bf8cf0710530 is going to be updated. [ 712.852042] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.852512] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.853341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.880375] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.880546] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.880603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.880836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.880979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.881275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d852207d-5092-40c0-bc22-bf8cf0710530" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.293831] env[70535]: INFO networking_nsxv3.common.synchronization [req-028c512e-1048-4034-9f8e-52486d55b8bf req-30059625-ac56-4bf4-8117-9a04a3e9cab0 tempest-ServerExternalEventsTest-1999822074 tempest-ServerExternalEventsTest-1999822074-project-member] Enqueued Resource ID: 56df97d7-88f0-451d-89de-62650bdc9016 with Priority: HIGHEST for action security_group_members [ 713.294326] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56df97d7-88f0-451d-89de-62650bdc9016 with Priority: HIGHEST for action security_group_members [ 713.300070] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-56df97d7-88f0-451d-89de-62650bdc9016 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.300070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.300070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.300070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.300070] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.300070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.300070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.300070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.300070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.300070] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56df97d7-88f0-451d-89de-62650bdc9016',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.357815] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.806407] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.806407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.806407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.806407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.806407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.806407] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.808717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.808717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.808717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.808717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.808717] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56df97d7-88f0-451d-89de-62650bdc9016 is going to be updated. [ 713.843355] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.843355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.843355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.843355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.843355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.860828] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56df97d7-88f0-451d-89de-62650bdc9016 in Status: IN_PROGRESS for 2s [ 713.867248] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.867248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.867248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.867248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.867248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.867248] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 is going to be created. [ 713.895341] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.895341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.895341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.895341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.895341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.911579] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: UNINITIALIZED for 2s [ 713.930248] env[70535]: INFO networking_nsxv3.common.synchronization [None req-22e39c4e-82cd-45ad-8eb3-5d309f8bfa63 None None] Enqueued Resource ID: ee92430c-c6db-41cf-a3e1-d9df37a6d21b with Priority: HIGHEST for action port [ 713.930532] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee92430c-c6db-41cf-a3e1-d9df37a6d21b with Priority: HIGHEST for action port [ 713.932861] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee92430c-c6db-41cf-a3e1-d9df37a6d21b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.932861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee92430c-c6db-41cf-a3e1-d9df37a6d21b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.932861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee92430c-c6db-41cf-a3e1-d9df37a6d21b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.932861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee92430c-c6db-41cf-a3e1-d9df37a6d21b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.932861] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee92430c-c6db-41cf-a3e1-d9df37a6d21b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.436442] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee92430c-c6db-41cf-a3e1-d9df37a6d21b [ 714.436442] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.436667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.436667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.437071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.437071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.437181] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee92430c-c6db-41cf-a3e1-d9df37a6d21b already deleted. [ 714.437568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee92430c-c6db-41cf-a3e1-d9df37a6d21b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.823847] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec60a8db-faf5-42bd-94a8-662a5418627b in Status: SUCCESS [ 714.824632] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.244817] env[70535]: INFO networking_nsxv3.common.synchronization [None req-2bb36845-aeea-4ec7-8071-53dfce715e42 None None] Enqueued Resource ID: e672b389-ecf7-45a1-925a-c2f1b3d956a9 with Priority: HIGHEST for action port [ 715.245974] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e672b389-ecf7-45a1-925a-c2f1b3d956a9 with Priority: HIGHEST for action port [ 715.247268] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-e672b389-ecf7-45a1-925a-c2f1b3d956a9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.247773] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e672b389-ecf7-45a1-925a-c2f1b3d956a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.247873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e672b389-ecf7-45a1-925a-c2f1b3d956a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.248200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e672b389-ecf7-45a1-925a-c2f1b3d956a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.248287] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e672b389-ecf7-45a1-925a-c2f1b3d956a9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.497397] env[70535]: INFO networking_nsxv3.common.synchronization [None req-1507bb90-754b-4eee-b2b0-5cf995e54253 None None] Enqueued Resource ID: 7c231479-f691-4a4e-ab4a-fa44b4fc65aa with Priority: HIGHEST for action port [ 715.497397] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c231479-f691-4a4e-ab4a-fa44b4fc65aa with Priority: HIGHEST for action port [ 715.499163] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c231479-f691-4a4e-ab4a-fa44b4fc65aa taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.499163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c231479-f691-4a4e-ab4a-fa44b4fc65aa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.499163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c231479-f691-4a4e-ab4a-fa44b4fc65aa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.499163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c231479-f691-4a4e-ab4a-fa44b4fc65aa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.499163] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c231479-f691-4a4e-ab4a-fa44b4fc65aa',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.752748] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e672b389-ecf7-45a1-925a-c2f1b3d956a9 [ 715.753236] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.753236] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.753386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.754134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.754134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.754134] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e672b389-ecf7-45a1-925a-c2f1b3d956a9 already deleted. [ 715.754134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e672b389-ecf7-45a1-925a-c2f1b3d956a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.872831] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56df97d7-88f0-451d-89de-62650bdc9016 in Status: SUCCESS [ 715.872831] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56df97d7-88f0-451d-89de-62650bdc9016 deletion is rescheduled due to dependency. [ 715.872831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.930159] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: SUCCESS [ 715.930637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.931186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.931581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.931942] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.932264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.932493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.932815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.933018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.933201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.933382] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.005099] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c231479-f691-4a4e-ab4a-fa44b4fc65aa [ 716.005099] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.005099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.005259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.008066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.008066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.008066] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c231479-f691-4a4e-ab4a-fa44b4fc65aa already deleted. [ 716.008066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c231479-f691-4a4e-ab4a-fa44b4fc65aa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.438643] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.590215] env[70535]: INFO networking_nsxv3.common.synchronization [req-8f7ac889-54b6-4abc-af35-e96534b78a38 req-974ea057-719f-467e-91b9-4180e1026b9f tempest-ListServersNegativeTestJSON-1092584325 tempest-ListServersNegativeTestJSON-1092584325-project-member] Enqueued Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 716.590215] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 716.590215] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.593028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.593028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.593028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.593028] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.593028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.593028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.593028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.593028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.593028] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.682023] env[70535]: INFO networking_nsxv3.common.synchronization [None req-913b1b6d-60a8-4103-aba5-c239d4d51436 None None] Enqueued Resource ID: 2fd514da-d308-4a5d-8e6a-ab1d1aefe9e6 with Priority: HIGHEST for action port [ 716.682023] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fd514da-d308-4a5d-8e6a-ab1d1aefe9e6 with Priority: HIGHEST for action port [ 716.682468] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fd514da-d308-4a5d-8e6a-ab1d1aefe9e6 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.683921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fd514da-d308-4a5d-8e6a-ab1d1aefe9e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.683921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fd514da-d308-4a5d-8e6a-ab1d1aefe9e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.683921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fd514da-d308-4a5d-8e6a-ab1d1aefe9e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.683921] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fd514da-d308-4a5d-8e6a-ab1d1aefe9e6',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.941806] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d004720e-0079-4896-920b-7b1e57b6b7b8: rpc.has_security_group_logging(os_id): False [ 716.962468] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.962721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.962721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.963106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.963417] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.963417] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.964021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.964021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.964021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.964021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.964021] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 is going to be created. [ 717.044195] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.044195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.044195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.044195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.044195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.059513] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: IN_PROGRESS for 2s [ 717.094669] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.094903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.094903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.095179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.095293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.095473] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.095577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.095638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.095789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.095874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.095932] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00628945-9b3d-4cd6-939f-483e37c62dbe already deleted. [ 717.096070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.186499] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fd514da-d308-4a5d-8e6a-ab1d1aefe9e6 [ 717.186974] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.187234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.187791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.187791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.187791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.187942] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fd514da-d308-4a5d-8e6a-ab1d1aefe9e6 already deleted. [ 717.187942] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fd514da-d308-4a5d-8e6a-ab1d1aefe9e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.447427] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.447427] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-396" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.447427] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-396" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.447626] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-396" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.447869] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.447996] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.449366] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.450788] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.450788] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.450788] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.450788] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.450788] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.450788] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.450788] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.450788] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.450788] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.481239] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.481445] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 717.482079] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.482079] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-396" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.482266] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-9f6d5adb-ac7b-4270-9de0-41be1f7b331e taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.482461] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-9f6d5adb-ac7b-4270-9de0-41be1f7b331e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.483272] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-9f6d5adb-ac7b-4270-9de0-41be1f7b331e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.483394] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-9f6d5adb-ac7b-4270-9de0-41be1f7b331e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.483545] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f6d5adb-ac7b-4270-9de0-41be1f7b331e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.774269] env[70535]: INFO networking_nsxv3.common.synchronization [None req-26e7aca8-2fa6-4be6-a194-4ef8aec7acc4 None None] Enqueued Resource ID: b7509cca-1c15-4883-ba81-9fe172e823e5 with Priority: HIGHEST for action port [ 717.774544] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7509cca-1c15-4883-ba81-9fe172e823e5 with Priority: HIGHEST for action port [ 717.777383] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7509cca-1c15-4883-ba81-9fe172e823e5 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.777383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7509cca-1c15-4883-ba81-9fe172e823e5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.777383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7509cca-1c15-4883-ba81-9fe172e823e5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.778635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7509cca-1c15-4883-ba81-9fe172e823e5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.778728] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7509cca-1c15-4883-ba81-9fe172e823e5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.986577] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.987063] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.987063] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.987137] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.987924] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.987924] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 9f6d5adb-ac7b-4270-9de0-41be1f7b331e not found, creating... [ 717.987924] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.987924] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.988141] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.988267] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.988408] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.988732] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.989446] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.989690] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.989801] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.989901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.990126] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 9f6d5adb-ac7b-4270-9de0-41be1f7b331e is going to be created. [ 717.993671] env[70535]: INFO networking_nsxv3.common.synchronization [None req-2750f9a1-19a0-4495-9050-dab8fbd381d1 None None] Enqueued Resource ID: 48d0250a-c20d-45a1-b49c-413e1b742b36 with Priority: HIGHEST for action port [ 717.996663] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d0250a-c20d-45a1-b49c-413e1b742b36 with Priority: HIGHEST for action port [ 717.996663] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-48d0250a-c20d-45a1-b49c-413e1b742b36 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.996663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48d0250a-c20d-45a1-b49c-413e1b742b36" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.996663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48d0250a-c20d-45a1-b49c-413e1b742b36" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.996663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48d0250a-c20d-45a1-b49c-413e1b742b36" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.996663] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48d0250a-c20d-45a1-b49c-413e1b742b36',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.014524] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.017436] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.017436] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.017436] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.017436] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.017436] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-9f6d5adb-ac7b-4270-9de0-41be1f7b331e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.284519] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7509cca-1c15-4883-ba81-9fe172e823e5 [ 718.284683] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.284873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.285045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.285198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.285752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.285752] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7509cca-1c15-4883-ba81-9fe172e823e5 already deleted. [ 718.285752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7509cca-1c15-4883-ba81-9fe172e823e5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.499469] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48d0250a-c20d-45a1-b49c-413e1b742b36 [ 718.499757] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.499933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.500802] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.500802] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.500802] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.500802] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48d0250a-c20d-45a1-b49c-413e1b742b36 already deleted. [ 718.500802] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48d0250a-c20d-45a1-b49c-413e1b742b36" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.631512] env[70535]: INFO networking_nsxv3.common.synchronization [None req-614fbd2c-bb42-4541-9857-26eff14b7f9e None None] Enqueued Resource ID: 2176a47f-e097-4cfd-b377-13f93380f874 with Priority: HIGHEST for action port [ 718.631751] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2176a47f-e097-4cfd-b377-13f93380f874 with Priority: HIGHEST for action port [ 718.632824] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-2176a47f-e097-4cfd-b377-13f93380f874 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.632977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2176a47f-e097-4cfd-b377-13f93380f874" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.633066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2176a47f-e097-4cfd-b377-13f93380f874" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.633409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2176a47f-e097-4cfd-b377-13f93380f874" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.633409] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2176a47f-e097-4cfd-b377-13f93380f874',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.072833] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: SUCCESS [ 719.073164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.100061] env[70535]: INFO networking_nsxv3.common.synchronization [None req-b5b55d91-83a7-47a9-9124-33a78c94f758 tempest-ServerActionsTestOtherB-1362861695 tempest-ServerActionsTestOtherB-1362861695-project-member] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_rules [ 719.100721] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_rules [ 719.101287] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.101459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.101527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.101812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.101893] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.139692] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2176a47f-e097-4cfd-b377-13f93380f874 [ 719.139692] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.139692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.139692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.139692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.139692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.139692] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2176a47f-e097-4cfd-b377-13f93380f874 already deleted. [ 719.139692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2176a47f-e097-4cfd-b377-13f93380f874" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.399161] env[70535]: INFO networking_nsxv3.common.synchronization [None req-f126d2af-0e37-4c9b-89ac-9cfb8d758457 tempest-ServerActionsTestOtherB-1362861695 tempest-ServerActionsTestOtherB-1362861695-project-member] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_rules [ 719.400246] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_rules [ 719.401149] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.401338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.636534] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.636534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.636534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.636534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.636534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.636534] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c already deleted. [ 719.636534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.636534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.637179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.637179] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.862252] env[70535]: INFO networking_nsxv3.common.synchronization [req-8f7ac889-54b6-4abc-af35-e96534b78a38 req-92b28cdf-c4f3-4c55-a0c0-948180fd5b23 tempest-ListServersNegativeTestJSON-1092584325 tempest-ListServersNegativeTestJSON-1092584325-project-member] Enqueued Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 719.863342] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 719.863727] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.863935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.867036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.867036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.867036] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.867036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.867036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.867036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.867036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.867036] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.127538] env[70535]: INFO networking_nsxv3.common.synchronization [req-8f7ac889-54b6-4abc-af35-e96534b78a38 req-772e94d7-5261-4b56-89b2-a1f309879965 service nova] Enqueued Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_rules [ 720.127538] env[70535]: INFO networking_nsxv3.common.synchronization [req-8f7ac889-54b6-4abc-af35-e96534b78a38 req-772e94d7-5261-4b56-89b2-a1f309879965 service nova] Enqueued Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 720.127538] env[70535]: INFO networking_nsxv3.common.synchronization [req-8f7ac889-54b6-4abc-af35-e96534b78a38 req-772e94d7-5261-4b56-89b2-a1f309879965 service nova] Enqueued Resource ID: 9f6d5adb-ac7b-4270-9de0-41be1f7b331e with Priority: HIGHEST for action port [ 720.127538] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_rules [ 720.127538] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 720.127538] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f6d5adb-ac7b-4270-9de0-41be1f7b331e with Priority: HIGHEST for action port [ 720.127538] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.128397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.128397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.128605] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.128669] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.129732] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.129732] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.131473] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f6d5adb-ac7b-4270-9de0-41be1f7b331e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.131637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f6d5adb-ac7b-4270-9de0-41be1f7b331e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.131749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f6d5adb-ac7b-4270-9de0-41be1f7b331e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.132085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f6d5adb-ac7b-4270-9de0-41be1f7b331e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.132135] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f6d5adb-ac7b-4270-9de0-41be1f7b331e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.174119] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.174119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.174119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.174119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.174119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.174119] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c already deleted. [ 720.174119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.368227] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.635738] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.635919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.640552] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f6d5adb-ac7b-4270-9de0-41be1f7b331e with status ACTIVE [ 720.640783] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.641028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.641028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.641325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.641415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.641831] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.641987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.642073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.642250] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.642387] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.642512] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.642619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.642736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.642838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.642908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.643013] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f6d5adb-ac7b-4270-9de0-41be1f7b331e is going to be updated. [ 720.669762] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.669997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.669997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.671966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.671966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.671966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f6d5adb-ac7b-4270-9de0-41be1f7b331e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.875130] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.037479] env[70535]: INFO networking_nsxv3.common.synchronization [None req-60633881-6829-4bf3-b478-0c43db1e9402 None None] Enqueued Resource ID: 6cf7f4cb-07fa-4787-ad02-08e8150827c3 with Priority: HIGHEST for action port [ 721.038089] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cf7f4cb-07fa-4787-ad02-08e8150827c3 with Priority: HIGHEST for action port [ 721.038332] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cf7f4cb-07fa-4787-ad02-08e8150827c3 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.038455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cf7f4cb-07fa-4787-ad02-08e8150827c3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.038520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cf7f4cb-07fa-4787-ad02-08e8150827c3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.038775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cf7f4cb-07fa-4787-ad02-08e8150827c3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.038849] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cf7f4cb-07fa-4787-ad02-08e8150827c3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.098395] env[70535]: INFO networking_nsxv3.common.synchronization [None req-64a490ce-e349-473a-9a00-c66a5ff34be6 None None] Enqueued Resource ID: 029aea5b-636b-43cf-af1d-1411ae1a9b00 with Priority: HIGHEST for action port [ 721.098922] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 029aea5b-636b-43cf-af1d-1411ae1a9b00 with Priority: HIGHEST for action port [ 721.099464] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-029aea5b-636b-43cf-af1d-1411ae1a9b00 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.099591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-029aea5b-636b-43cf-af1d-1411ae1a9b00" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.099679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-029aea5b-636b-43cf-af1d-1411ae1a9b00" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.099935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-029aea5b-636b-43cf-af1d-1411ae1a9b00" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.101192] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('029aea5b-636b-43cf-af1d-1411ae1a9b00',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.137520] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.137520] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-396" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.137520] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-396" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.137520] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-396" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.137520] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.138046] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.138046] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.138046] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.138266] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.138378] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.141215] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.141215] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.141215] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.141215] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.141215] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.141215] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.154971] env[70535]: INFO networking_nsxv3.common.synchronization [req-e6170537-77bd-4a92-93c2-6ed41106e8df req-01861bb3-8571-4a6c-85ef-05d346f82851 tempest-ImagesTestJSON-1564979202 tempest-ImagesTestJSON-1564979202-project-member] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 721.154971] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 721.154971] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.154971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.154971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.154971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.154971] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.154971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.154971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.154971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.154971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.154971] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.161387] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.161387] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 721.161387] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.161387] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-396" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.162704] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-71e8cc0f-fe95-4bb9-9536-7347fc07b39a taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.162704] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-71e8cc0f-fe95-4bb9-9536-7347fc07b39a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.162704] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-71e8cc0f-fe95-4bb9-9536-7347fc07b39a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.164033] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-71e8cc0f-fe95-4bb9-9536-7347fc07b39a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.164331] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71e8cc0f-fe95-4bb9-9536-7347fc07b39a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.367996] env[70535]: INFO networking_nsxv3.common.synchronization [req-f16216fc-a6aa-4998-ad49-b94957d6e8be req-0c9087bb-da98-4726-951a-3788b57432ac tempest-DeleteServersAdminTestJSON-21744185 tempest-DeleteServersAdminTestJSON-21744185-project-member] Enqueued Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_members [ 721.368840] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGHEST for action security_group_members [ 721.368840] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.369129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.369129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.374445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.374654] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.374784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.374871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.375057] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.376668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.376668] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.381171] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.381171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.381171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.381171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.381171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.381171] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00628945-9b3d-4cd6-939f-483e37c62dbe is going to be created. [ 721.416310] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.416804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.416804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.416945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.417091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.435845] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: UNINITIALIZED for 2s [ 721.541513] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cf7f4cb-07fa-4787-ad02-08e8150827c3 [ 721.542893] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.542893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.542893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.542893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.542893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.542893] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cf7f4cb-07fa-4787-ad02-08e8150827c3 already deleted. [ 721.542893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cf7f4cb-07fa-4787-ad02-08e8150827c3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.604133] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 029aea5b-636b-43cf-af1d-1411ae1a9b00 [ 721.605875] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.608021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.608021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.608021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.608021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.608021] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:029aea5b-636b-43cf-af1d-1411ae1a9b00 already deleted. [ 721.608021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-029aea5b-636b-43cf-af1d-1411ae1a9b00" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.660676] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.660916] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.661300] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.662908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.663075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.663382] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.663524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.663582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.664643] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.664643] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.664643] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 721.672047] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.672403] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.672615] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.673196] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.673419] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.673663] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 71e8cc0f-fe95-4bb9-9536-7347fc07b39a not found, creating... [ 721.674147] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.674400] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.674563] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.675239] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.675556] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.676079] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.676395] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.676757] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.677114] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.677497] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.680415] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 71e8cc0f-fe95-4bb9-9536-7347fc07b39a is going to be created. [ 721.710294] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.710634] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.710769] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.711088] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.711340] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.711690] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-71e8cc0f-fe95-4bb9-9536-7347fc07b39a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.723576] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.723576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.723713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.724075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.724177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.736924] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 721.879894] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.883281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.883396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.883635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.883733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.883969] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.884106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.884167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.884323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.884400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.884488] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 is going to be updated. [ 721.889555] env[70535]: INFO networking_nsxv3.common.synchronization [req-7c224291-0bd4-47fa-851e-3de5366a9463 req-e6f177b5-74c6-4e0c-8061-885f8d529fd1 tempest-InstanceActionsV221TestJSON-1235496730 tempest-InstanceActionsV221TestJSON-1235496730-project-member] Enqueued Resource ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 with Priority: HIGHEST for action security_group_members [ 721.890555] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 with Priority: HIGHEST for action security_group_members [ 721.890905] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-29ee0426-6a12-4c04-9765-fa731a9837a7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.891886] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.892008] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.892238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.892436] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.892573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.892618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.892841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.893196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.893323] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29ee0426-6a12-4c04-9765-fa731a9837a7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.926987] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.927233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.927233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.927497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.927608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.939029] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 in Status: IN_PROGRESS for 2s [ 722.141702] env[70535]: INFO networking_nsxv3.common.synchronization [None req-d645fa7d-70b1-40fe-ad7b-2f04415225dc None None] Enqueued Resource ID: 0fedd845-b44c-426e-803f-1a20da93f5e5 with Priority: HIGHEST for action port [ 722.143881] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fedd845-b44c-426e-803f-1a20da93f5e5 with Priority: HIGHEST for action port [ 722.143881] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fedd845-b44c-426e-803f-1a20da93f5e5 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.143881] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fedd845-b44c-426e-803f-1a20da93f5e5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.143881] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fedd845-b44c-426e-803f-1a20da93f5e5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.144346] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fedd845-b44c-426e-803f-1a20da93f5e5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.144468] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fedd845-b44c-426e-803f-1a20da93f5e5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.401018] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.401018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.401018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.401018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.401018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.401018] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.401018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.401018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.401018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.401018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.401018] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 is going to be updated. [ 722.436022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.436022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.436022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.436022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.436022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.444496] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 in Status: IN_PROGRESS for 2s [ 722.458495] env[70535]: INFO networking_nsxv3.common.synchronization [None req-028bb861-5a6f-4279-979c-be3e6a8ef7f6 tempest-ServersTestFqdnHostnames-408043169 tempest-ServersTestFqdnHostnames-408043169-project-member] Enqueued Resource ID: 89135034-9b45-4344-b065-0229db08f4f9 with Priority: HIGHEST for action security_group_rules [ 722.459210] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89135034-9b45-4344-b065-0229db08f4f9 with Priority: HIGHEST for action security_group_rules [ 722.459380] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89135034-9b45-4344-b065-0229db08f4f9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.459535] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.459652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.459975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.460110] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89135034-9b45-4344-b065-0229db08f4f9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.636718] env[70535]: INFO networking_nsxv3.common.synchronization [None req-572e4b02-76f0-4809-a42a-39e0e3e1f9ef tempest-ServersTestFqdnHostnames-408043169 tempest-ServersTestFqdnHostnames-408043169-project-member] Enqueued Resource ID: 89135034-9b45-4344-b065-0229db08f4f9 with Priority: HIGHEST for action security_group_rules [ 722.637147] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89135034-9b45-4344-b065-0229db08f4f9 with Priority: HIGHEST for action security_group_rules [ 722.643364] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89135034-9b45-4344-b065-0229db08f4f9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.646034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.650454] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fedd845-b44c-426e-803f-1a20da93f5e5 [ 722.650681] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.650948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.650948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.651127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.651217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.651310] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fedd845-b44c-426e-803f-1a20da93f5e5 already deleted. [ 722.651391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fedd845-b44c-426e-803f-1a20da93f5e5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.896915] env[70535]: INFO networking_nsxv3.common.synchronization [None req-8da167bf-7aa7-4854-8b2c-9e994dc399af tempest-ServersTestJSON-1256413413 tempest-ServersTestJSON-1256413413-project-member] Enqueued Resource ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 with Priority: HIGHEST for action security_group_rules [ 722.897513] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 with Priority: HIGHEST for action security_group_rules [ 722.897814] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.897944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.898023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.898288] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.898685] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46eec3ed-88a9-4ea1-a649-2f92efa91eb5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.984471] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.984645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.984697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.984915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.985061] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.985124] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89135034-9b45-4344-b065-0229db08f4f9 already deleted. [ 722.985178] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.985332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.985490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.985571] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89135034-9b45-4344-b065-0229db08f4f9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.055349] env[70535]: INFO networking_nsxv3.common.synchronization [None req-08707c7d-6194-4a6c-a79d-fa73b1305a09 tempest-ServersTestJSON-1256413413 tempest-ServersTestJSON-1256413413-project-member] Enqueued Resource ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 with Priority: HIGHEST for action security_group_rules [ 723.056738] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 with Priority: HIGHEST for action security_group_rules [ 723.056973] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.057091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.113825] env[70535]: INFO networking_nsxv3.common.synchronization [req-8f7ac889-54b6-4abc-af35-e96534b78a38 req-1939d8c6-1e3d-4fd6-a91b-6bf4044552db service nova] Enqueued Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_rules [ 723.113825] env[70535]: INFO networking_nsxv3.common.synchronization [req-8f7ac889-54b6-4abc-af35-e96534b78a38 req-1939d8c6-1e3d-4fd6-a91b-6bf4044552db service nova] Enqueued Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 723.113825] env[70535]: INFO networking_nsxv3.common.synchronization [req-8f7ac889-54b6-4abc-af35-e96534b78a38 req-1939d8c6-1e3d-4fd6-a91b-6bf4044552db service nova] Enqueued Resource ID: 71e8cc0f-fe95-4bb9-9536-7347fc07b39a with Priority: HIGHEST for action port [ 723.113825] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_rules [ 723.113825] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 723.113825] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71e8cc0f-fe95-4bb9-9536-7347fc07b39a with Priority: HIGHEST for action port [ 723.113825] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.114428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.114772] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.115010] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.116870] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-71e8cc0f-fe95-4bb9-9536-7347fc07b39a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.116870] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71e8cc0f-fe95-4bb9-9536-7347fc07b39a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.116870] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71e8cc0f-fe95-4bb9-9536-7347fc07b39a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.116870] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71e8cc0f-fe95-4bb9-9536-7347fc07b39a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.116870] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71e8cc0f-fe95-4bb9-9536-7347fc07b39a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.420838] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.420838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.420838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.421306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.421306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.421306] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 already deleted. [ 723.421306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.421460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.421751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.421751] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46eec3ed-88a9-4ea1-a649-2f92efa91eb5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.442830] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: SUCCESS [ 723.443100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.443262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.443487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.443768] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.443885] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.443885] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.444017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.444311] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.445288] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.509770] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.510429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.510429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.510429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.510429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.510429] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89135034-9b45-4344-b065-0229db08f4f9 already deleted. [ 723.510679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.619452] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71e8cc0f-fe95-4bb9-9536-7347fc07b39a with status ACTIVE [ 723.620167] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.622560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.622560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.622560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.622560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.622560] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.622560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.622560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.622932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.623118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.623553] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.623758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.623882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.624175] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.624317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.624422] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71e8cc0f-fe95-4bb9-9536-7347fc07b39a is going to be updated. [ 723.648761] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.649429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.649429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.649429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.649429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.649626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71e8cc0f-fe95-4bb9-9536-7347fc07b39a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.747044] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 723.747462] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e deletion is rescheduled due to dependency. [ 723.747883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.845405] env[70535]: INFO networking_nsxv3.common.synchronization [None req-fbb50b0e-c318-4f2e-81e3-b0356196b493 None None] Enqueued Resource ID: 04e7628b-8658-4ce0-8d04-631c48b06223 with Priority: HIGHEST for action port [ 723.845405] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e7628b-8658-4ce0-8d04-631c48b06223 with Priority: HIGHEST for action port [ 723.845405] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-04e7628b-8658-4ce0-8d04-631c48b06223 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.845405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04e7628b-8658-4ce0-8d04-631c48b06223" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.845405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04e7628b-8658-4ce0-8d04-631c48b06223" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.845405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04e7628b-8658-4ce0-8d04-631c48b06223" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.845405] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04e7628b-8658-4ce0-8d04-631c48b06223',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.942037] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.942320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.942320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.942531] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.942630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.942797] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 already deleted. [ 723.942897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.946381] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.950993] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 in Status: SUCCESS [ 723.950993] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 deletion is rescheduled due to dependency. [ 723.951276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.025715] env[70535]: INFO networking_nsxv3.common.synchronization [req-8f7ac889-54b6-4abc-af35-e96534b78a38 req-73944f48-b659-4cb6-80d1-b668749f6a36 tempest-ListServersNegativeTestJSON-1092584325 tempest-ListServersNegativeTestJSON-1092584325-project-member] Enqueued Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 724.026111] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 724.026447] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.026557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.346543] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04e7628b-8658-4ce0-8d04-631c48b06223 [ 724.346812] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.346967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.347055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.347302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.347395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.347498] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04e7628b-8658-4ce0-8d04-631c48b06223 already deleted. [ 724.347593] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04e7628b-8658-4ce0-8d04-631c48b06223" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.448385] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.456114] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 in Status: SUCCESS [ 724.456114] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 deletion is rescheduled due to dependency. [ 724.456114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.951561] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.951561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.951561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.951794] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.951884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.951986] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00628945-9b3d-4cd6-939f-483e37c62dbe is going to be updated. [ 724.987486] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.987629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.987760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.987927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.988166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.999194] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: IN_PROGRESS for 2s [ 725.122362] env[70535]: INFO networking_nsxv3.common.synchronization [None req-8f98c79d-8a63-478c-8f36-b4fac9b126c5 tempest-VolumesAdminNegativeTest-1297223157 tempest-VolumesAdminNegativeTest-1297223157-project-member] Enqueued Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGHEST for action security_group_rules [ 725.123602] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGHEST for action security_group_rules [ 725.124062] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b05014f4-0d5c-444e-a37c-dbe58f585d75 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.124244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.124512] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.124906] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.125248] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b05014f4-0d5c-444e-a37c-dbe58f585d75',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.233675] env[70535]: INFO networking_nsxv3.common.synchronization [None req-68b9edfd-855d-4bef-9487-4921fb731096 tempest-VolumesAdminNegativeTest-1297223157 tempest-VolumesAdminNegativeTest-1297223157-project-member] Enqueued Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGHEST for action security_group_rules [ 725.233675] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGHEST for action security_group_rules [ 725.233675] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b05014f4-0d5c-444e-a37c-dbe58f585d75 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.233675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.336188] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.336690] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-396" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.338842] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-396" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.339355] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-396" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.339841] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.340384] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.340661] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.341120] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.342069] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.344880] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.344880] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.345139] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.345214] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.345332] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.345532] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.345733] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.373021] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.373021] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 725.373021] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.373021] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-396" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.373021] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-b413810a-888f-48f1-a034-8ae6fa469e3c taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.373021] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-b413810a-888f-48f1-a034-8ae6fa469e3c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.373021] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-b413810a-888f-48f1-a034-8ae6fa469e3c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.373566] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-b413810a-888f-48f1-a034-8ae6fa469e3c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.373566] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b413810a-888f-48f1-a034-8ae6fa469e3c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.650661] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.651033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.651033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.651135] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.651276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.651401] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 already deleted. [ 725.651496] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.652036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.652036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.652036] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b05014f4-0d5c-444e-a37c-dbe58f585d75',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.880177] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.880177] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.880177] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.880177] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.880578] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.880798] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port b413810a-888f-48f1-a034-8ae6fa469e3c not found, creating... [ 725.881797] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.882241] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.882633] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.883099] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.883600] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.884229] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.884935] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.885217] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.885574] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.885886] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.886154] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: b413810a-888f-48f1-a034-8ae6fa469e3c is going to be created. [ 725.910466] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.910466] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.910466] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.910466] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.910466] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.910466] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-b413810a-888f-48f1-a034-8ae6fa469e3c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.178597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.178597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.178597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.178597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.178597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.178597] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 already deleted. [ 726.179366] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.883581] env[70535]: INFO networking_nsxv3.common.synchronization [req-8f7ac889-54b6-4abc-af35-e96534b78a38 req-c8adb94b-65de-4bb3-ade2-17f4aeafc004 service nova] Enqueued Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_rules [ 726.883922] env[70535]: INFO networking_nsxv3.common.synchronization [req-8f7ac889-54b6-4abc-af35-e96534b78a38 req-c8adb94b-65de-4bb3-ade2-17f4aeafc004 service nova] Enqueued Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 726.884058] env[70535]: INFO networking_nsxv3.common.synchronization [req-8f7ac889-54b6-4abc-af35-e96534b78a38 req-c8adb94b-65de-4bb3-ade2-17f4aeafc004 service nova] Enqueued Resource ID: b413810a-888f-48f1-a034-8ae6fa469e3c with Priority: HIGHEST for action port [ 726.885537] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_rules [ 726.885681] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 726.885785] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b413810a-888f-48f1-a034-8ae6fa469e3c with Priority: HIGHEST for action port [ 726.886091] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.886204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.886401] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.886508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.886655] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-b413810a-888f-48f1-a034-8ae6fa469e3c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.887260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b413810a-888f-48f1-a034-8ae6fa469e3c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.887260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b413810a-888f-48f1-a034-8ae6fa469e3c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.887260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b413810a-888f-48f1-a034-8ae6fa469e3c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.887260] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b413810a-888f-48f1-a034-8ae6fa469e3c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.011423] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: SUCCESS [ 727.011659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.011862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.012066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.012265] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.012380] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.012479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.013014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.013165] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.013218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.013313] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.016162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.016162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.016162] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.016162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.016162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.016162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.016162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.016572] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.392902] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b413810a-888f-48f1-a034-8ae6fa469e3c with status ACTIVE [ 727.393200] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.393349] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.393424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.393659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.393798] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.393947] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.394088] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.394088] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.394252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.394305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.394477] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.394572] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.394629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.394763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.394837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.394912] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b413810a-888f-48f1-a034-8ae6fa469e3c is going to be updated. [ 727.426160] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.426315] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.426391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.426683] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.427057] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.427057] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b413810a-888f-48f1-a034-8ae6fa469e3c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.516978] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.516978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.518862] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.698469] env[70535]: INFO networking_nsxv3.common.synchronization [req-9a3d7ae3-bf15-45b6-80db-0cce709ce1bd req-9368d0fb-901d-4b53-a3fb-768c8538ae66 tempest-FloatingIPsAssociationTestJSON-570582915 tempest-FloatingIPsAssociationTestJSON-570582915-project-member] Enqueued Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_members [ 727.699561] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_members [ 727.699913] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.700056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.700123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.700341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.700499] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.700597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.700662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.700837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.700929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.701055] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.021018] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.209598] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.523960] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.524188] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.524584] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.526164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.526164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.526330] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00628945-9b3d-4cd6-939f-483e37c62dbe is going to be updated. [ 728.570330] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.570653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.570653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.571200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.571200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.587198] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: IN_PROGRESS for 2s [ 728.680068] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.681159] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.681159] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.681159] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.681159] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.681376] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.681683] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.681810] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.681953] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.682177] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.682295] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.682406] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.682518] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.682629] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.682737] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.682940] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.708263] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.708780] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 728.708957] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.709234] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.709602] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-bfbd04e8-4cbe-4a9e-9e51-620a48afabbd taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.709742] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-bfbd04e8-4cbe-4a9e-9e51-620a48afabbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.709869] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-bfbd04e8-4cbe-4a9e-9e51-620a48afabbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.710263] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-bfbd04e8-4cbe-4a9e-9e51-620a48afabbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.710434] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfbd04e8-4cbe-4a9e-9e51-620a48afabbd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.715944] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.215900] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.216238] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.216357] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.216712] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.216913] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.217293] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port bfbd04e8-4cbe-4a9e-9e51-620a48afabbd not found, creating... [ 729.217692] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.217869] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.218113] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.218468] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.218624] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.218989] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.219982] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.220144] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.221220] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.221220] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.221220] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: bfbd04e8-4cbe-4a9e-9e51-620a48afabbd is going to be created. [ 729.223697] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.223697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.223697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.223697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.223697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.224717] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b34086e-8eac-4499-9c02-2280b24b0698 is going to be updated. [ 729.271534] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.271534] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.271534] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.271534] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.271534] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.271534] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-bfbd04e8-4cbe-4a9e-9e51-620a48afabbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.299681] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.299944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.299985] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.301152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.301421] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.316753] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: IN_PROGRESS for 2s [ 730.598893] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: SUCCESS [ 730.598893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.598893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.598893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.598893] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.598893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.598893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.599805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.599805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.599805] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.993949] env[70535]: INFO networking_nsxv3.common.synchronization [req-9a3d7ae3-bf15-45b6-80db-0cce709ce1bd req-b7d12933-4a94-4458-86fe-d998aa14251b service nova] Enqueued Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_rules [ 730.994194] env[70535]: INFO networking_nsxv3.common.synchronization [req-9a3d7ae3-bf15-45b6-80db-0cce709ce1bd req-b7d12933-4a94-4458-86fe-d998aa14251b service nova] Enqueued Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_members [ 730.994732] env[70535]: INFO networking_nsxv3.common.synchronization [req-9a3d7ae3-bf15-45b6-80db-0cce709ce1bd req-b7d12933-4a94-4458-86fe-d998aa14251b service nova] Enqueued Resource ID: bfbd04e8-4cbe-4a9e-9e51-620a48afabbd with Priority: HIGHEST for action port [ 730.995050] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_rules [ 730.995302] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_members [ 730.995428] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfbd04e8-4cbe-4a9e-9e51-620a48afabbd with Priority: HIGHEST for action port [ 730.995767] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.995926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.996009] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.996289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.996596] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.998279] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.998814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.999520] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfbd04e8-4cbe-4a9e-9e51-620a48afabbd taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.999520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfbd04e8-4cbe-4a9e-9e51-620a48afabbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.999520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfbd04e8-4cbe-4a9e-9e51-620a48afabbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.999520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfbd04e8-4cbe-4a9e-9e51-620a48afabbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.999754] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfbd04e8-4cbe-4a9e-9e51-620a48afabbd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.101932] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.328644] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: SUCCESS [ 731.329008] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.329199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.329443] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.329676] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.329760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.329825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.330094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.330094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.330201] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.503133] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.503133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.503265] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfbd04e8-4cbe-4a9e-9e51-620a48afabbd with status ACTIVE [ 731.503521] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.509901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.509901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.509901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.509901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.509901] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.509901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.509901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.509901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.509901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.509901] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.509901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.509901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.509901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.509901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.509901] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfbd04e8-4cbe-4a9e-9e51-620a48afabbd is going to be updated. [ 731.531849] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.532050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.532099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.532332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.532472] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.532630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfbd04e8-4cbe-4a9e-9e51-620a48afabbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.608533] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.834683] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.113720] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.114038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.114123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.114354] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.114795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.114795] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00628945-9b3d-4cd6-939f-483e37c62dbe is going to be updated. [ 732.185641] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.186103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.186433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.186772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.186986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.209166] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: IN_PROGRESS for 2s [ 732.338439] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.844576] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.844576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.844576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.844576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.844576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.844576] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b34086e-8eac-4499-9c02-2280b24b0698 is going to be updated. [ 732.875863] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.877189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.877189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.877189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.877189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.890023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: IN_PROGRESS for 2s [ 733.599200] env[70535]: INFO networking_nsxv3.common.synchronization [None req-83cf45e1-2e83-48a7-9392-9c7299692649 None None] Enqueued Resource ID: 59585128-54d3-4ccb-8285-d9b04dce36ab with Priority: HIGHEST for action port [ 733.601089] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59585128-54d3-4ccb-8285-d9b04dce36ab with Priority: HIGHEST for action port [ 733.601820] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-59585128-54d3-4ccb-8285-d9b04dce36ab taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.601962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59585128-54d3-4ccb-8285-d9b04dce36ab" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.602044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59585128-54d3-4ccb-8285-d9b04dce36ab" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.602319] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59585128-54d3-4ccb-8285-d9b04dce36ab" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.602408] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59585128-54d3-4ccb-8285-d9b04dce36ab',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.105494] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59585128-54d3-4ccb-8285-d9b04dce36ab [ 734.105900] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.105900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.105900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.106217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.106319] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.106433] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59585128-54d3-4ccb-8285-d9b04dce36ab already deleted. [ 734.106489] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59585128-54d3-4ccb-8285-d9b04dce36ab" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.220139] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: SUCCESS [ 734.220314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.220436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.220653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.220841] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.221655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.221655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.221655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.221655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.222046] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.727032] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.900535] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: SUCCESS [ 734.900871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.901083] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.901351] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.901570] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.901686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.901758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.901937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.902039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.902156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.902254] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.204492] env[70535]: INFO networking_nsxv3.common.synchronization [req-5a12de95-6704-4c4c-89c5-c77dccfa3a3e req-8552263a-d6c7-45cf-a9ea-a674f0d3f278 tempest-ServersAdminTestJSON-1221450413 tempest-ServersAdminTestJSON-1221450413-project-member] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 735.208559] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 735.208559] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.208559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.208559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.208559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.208559] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.208559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.208559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.208559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.208559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.208559] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.227979] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.405584] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.405677] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.406065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.406065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.406180] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.406307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.406307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.406444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.406547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.406617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.406767] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.407189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.407189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.407189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.407622] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.407622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.407622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.407622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.407622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.408544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.408544] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.711795] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.711795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.711795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.711795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.711795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.711795] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.711795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.711795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.711795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.714128] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.714274] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c already deleted. [ 735.714377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.731513] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.731704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.731764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.731933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.732034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.732130] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00628945-9b3d-4cd6-939f-483e37c62dbe is going to be updated. [ 735.763531] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.763728] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.763792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.764017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.764274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.775189] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: IN_PROGRESS for 2s [ 735.916318] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b34086e-8eac-4499-9c02-2280b24b0698: rpc.has_security_group_logging(os_id): False [ 735.928924] env[70535]: INFO networking_nsxv3.common.synchronization [None req-5120a268-846d-4caa-907a-be61797db741 None None] Enqueued Resource ID: 698d7226-0c97-4536-915c-360ec7bca6a1 with Priority: HIGHEST for action port [ 735.928924] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 698d7226-0c97-4536-915c-360ec7bca6a1 with Priority: HIGHEST for action port [ 735.928924] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-698d7226-0c97-4536-915c-360ec7bca6a1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.928924] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-698d7226-0c97-4536-915c-360ec7bca6a1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.928924] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-698d7226-0c97-4536-915c-360ec7bca6a1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.930635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-698d7226-0c97-4536-915c-360ec7bca6a1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.930635] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('698d7226-0c97-4536-915c-360ec7bca6a1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.934734] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.934734] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.934734] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.937194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.937194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.937194] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.937194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.937194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.937194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.937194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.937194] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.937194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.937194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.937194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.937194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.937194] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.937194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.937597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.937597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.940048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.940048] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b34086e-8eac-4499-9c02-2280b24b0698 is going to be updated. [ 736.008646] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.008777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.008874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.009650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.009650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.023104] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: IN_PROGRESS for 2s [ 736.288266] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-39 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.288625] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.288625] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.289207] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.289256] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.289676] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.289676] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.289968] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.290334] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.290470] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.290629] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.290834] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.290988] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.291125] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.291235] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.291372] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.315511] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.315511] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 736.315511] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.317325] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.317691] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-0ed312c6-343a-4421-ae88-6e16368a9c8a taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.317892] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-0ed312c6-343a-4421-ae88-6e16368a9c8a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.318023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-0ed312c6-343a-4421-ae88-6e16368a9c8a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.318395] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-0ed312c6-343a-4421-ae88-6e16368a9c8a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.318572] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ed312c6-343a-4421-ae88-6e16368a9c8a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.432659] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 698d7226-0c97-4536-915c-360ec7bca6a1 [ 736.432928] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.433125] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.433169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.433381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.433467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.433553] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:698d7226-0c97-4536-915c-360ec7bca6a1 already deleted. [ 736.433634] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-698d7226-0c97-4536-915c-360ec7bca6a1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.821437] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.821733] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.821937] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.822264] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.822425] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.822614] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 0ed312c6-343a-4421-ae88-6e16368a9c8a not found, creating... [ 736.823867] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.823867] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.823867] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.823867] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.823867] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.824418] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.824418] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.824576] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.824709] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.824866] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.825050] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 0ed312c6-343a-4421-ae88-6e16368a9c8a is going to be created. [ 736.850472] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.850607] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.851227] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.851321] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.851597] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.851909] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-0ed312c6-343a-4421-ae88-6e16368a9c8a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.422312] env[70535]: INFO networking_nsxv3.common.synchronization [None req-1b4a5c57-7e39-499e-a8cb-a8da9ea57566 None None] Enqueued Resource ID: bb5d5a02-0c40-410c-96f1-40e29a233464 with Priority: HIGHEST for action port [ 737.422553] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb5d5a02-0c40-410c-96f1-40e29a233464 with Priority: HIGHEST for action port [ 737.427061] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb5d5a02-0c40-410c-96f1-40e29a233464 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.427217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb5d5a02-0c40-410c-96f1-40e29a233464" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.427285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb5d5a02-0c40-410c-96f1-40e29a233464" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.427551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb5d5a02-0c40-410c-96f1-40e29a233464" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.427637] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb5d5a02-0c40-410c-96f1-40e29a233464',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.787155] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: SUCCESS [ 737.787535] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.788212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.788701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.789103] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.789871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.789871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.790179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.790482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.790482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.790783] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.790970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.791113] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.791365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.791692] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.791889] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.792043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.792294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.792459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.792636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.792799] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.935821] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb5d5a02-0c40-410c-96f1-40e29a233464 [ 737.935821] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.935821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.935821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.935821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.935821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.935821] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb5d5a02-0c40-410c-96f1-40e29a233464 already deleted. [ 737.935821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb5d5a02-0c40-410c-96f1-40e29a233464" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.041104] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: SUCCESS [ 738.041104] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.144970] env[70535]: INFO networking_nsxv3.common.synchronization [None req-fbc1ff4c-149e-43e2-9098-148e6fbac30a None None] Enqueued Resource ID: 896d13f6-f187-495b-a327-cd6397e0a790 with Priority: HIGHEST for action port [ 738.148064] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896d13f6-f187-495b-a327-cd6397e0a790 with Priority: HIGHEST for action port [ 738.148064] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-896d13f6-f187-495b-a327-cd6397e0a790 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.148064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-896d13f6-f187-495b-a327-cd6397e0a790" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.148064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-896d13f6-f187-495b-a327-cd6397e0a790" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.148064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-896d13f6-f187-495b-a327-cd6397e0a790" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.148064] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('896d13f6-f187-495b-a327-cd6397e0a790',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.295784] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00628945-9b3d-4cd6-939f-483e37c62dbe: rpc.has_security_group_logging(os_id): False [ 738.319307] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.319413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.319450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.319655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.319741] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.319961] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.320114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.320176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.320343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.320450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.320911] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.321087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.321152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.321301] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.321394] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.321581] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.321674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.321735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.321878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.321951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.322052] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00628945-9b3d-4cd6-939f-483e37c62dbe is going to be created. [ 738.399947] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.400443] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.400753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.403745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.403745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.408513] env[70535]: INFO networking_nsxv3.common.synchronization [req-5a12de95-6704-4c4c-89c5-c77dccfa3a3e req-9aa8ec09-91ee-44bc-a5c9-c1f935fe0ed7 service nova] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_rules [ 738.408513] env[70535]: INFO networking_nsxv3.common.synchronization [req-5a12de95-6704-4c4c-89c5-c77dccfa3a3e req-9aa8ec09-91ee-44bc-a5c9-c1f935fe0ed7 service nova] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 738.408513] env[70535]: INFO networking_nsxv3.common.synchronization [req-5a12de95-6704-4c4c-89c5-c77dccfa3a3e req-9aa8ec09-91ee-44bc-a5c9-c1f935fe0ed7 service nova] Enqueued Resource ID: 0ed312c6-343a-4421-ae88-6e16368a9c8a with Priority: HIGHEST for action port [ 738.408513] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_rules [ 738.408513] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 738.408513] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed312c6-343a-4421-ae88-6e16368a9c8a with Priority: HIGHEST for action port [ 738.409895] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.410248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.410433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.410760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.410935] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.412554] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.412810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.413025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.413316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.413595] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.414062] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.414341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.414683] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.414847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.415043] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.416383] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ed312c6-343a-4421-ae88-6e16368a9c8a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.416648] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ed312c6-343a-4421-ae88-6e16368a9c8a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.416794] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ed312c6-343a-4421-ae88-6e16368a9c8a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.417239] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ed312c6-343a-4421-ae88-6e16368a9c8a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.417455] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ed312c6-343a-4421-ae88-6e16368a9c8a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.419453] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: IN_PROGRESS for 2s [ 738.591043] env[70535]: INFO networking_nsxv3.common.synchronization [req-eceaf062-ae16-4a6f-a551-ef05b138f2fc req-2b6e7a65-4354-41e4-93a0-95c1dcf68f60 tempest-FloatingIPsAssociationNegativeTestJSON-584374596 tempest-FloatingIPsAssociationNegativeTestJSON-584374596-project-member] Enqueued Resource ID: ec60a8db-faf5-42bd-94a8-662a5418627b with Priority: HIGHEST for action security_group_members [ 738.591800] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec60a8db-faf5-42bd-94a8-662a5418627b with Priority: HIGHEST for action security_group_members [ 738.592182] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec60a8db-faf5-42bd-94a8-662a5418627b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.592347] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.592441] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.592680] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.592917] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.593094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.593177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.593355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.593815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.593815] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec60a8db-faf5-42bd-94a8-662a5418627b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.618092] env[70535]: INFO networking_nsxv3.common.synchronization [req-57406f42-cc79-4881-a325-eda3bc2a8513 req-6f490927-0284-4bba-8451-bf2d4f158567 tempest-ServersAdminTestJSON-1221450413 tempest-ServersAdminTestJSON-1221450413-project-member] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 738.618667] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 738.618958] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.619076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.650320] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 896d13f6-f187-495b-a327-cd6397e0a790 [ 738.650320] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.650320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.650320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.650320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.650320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.650320] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:896d13f6-f187-495b-a327-cd6397e0a790 already deleted. [ 738.650717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-896d13f6-f187-495b-a327-cd6397e0a790" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.924196] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.924196] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.924196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.924196] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ed312c6-343a-4421-ae88-6e16368a9c8a with status ACTIVE [ 738.924196] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.924196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.924196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.924196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.924196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.924196] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.924196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.924196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.924196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.924196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.924768] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.924768] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.924768] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.925733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.926040] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.926323] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ed312c6-343a-4421-ae88-6e16368a9c8a is going to be updated. [ 738.955143] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.955143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.955143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.955143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.955143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.955143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ed312c6-343a-4421-ae88-6e16368a9c8a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.096740] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.096740] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.096740] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.096935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.096935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.097261] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.097261] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.097261] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.097389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.097446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.097526] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec60a8db-faf5-42bd-94a8-662a5418627b is going to be updated. [ 739.125128] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.128539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.128539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.128539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.128539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.136591] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec60a8db-faf5-42bd-94a8-662a5418627b in Status: IN_PROGRESS for 2s [ 739.429050] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.674032] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-39 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.674032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.674032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.674032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.674032] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.674703] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.678027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.678027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.678027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.678027] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 739.678027] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.678027] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.678027] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.678027] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 739.678027] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.678027] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.709090] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.709090] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 739.709090] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.709090] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.709090] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-a32f36ce-7784-443e-8509-b399c02e826e taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.709090] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-a32f36ce-7784-443e-8509-b399c02e826e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.709090] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-a32f36ce-7784-443e-8509-b399c02e826e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.709090] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-a32f36ce-7784-443e-8509-b399c02e826e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.709090] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a32f36ce-7784-443e-8509-b399c02e826e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.931794] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.931794] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.932087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.932365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.932517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.933402] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be created. [ 739.964815] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.964815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.964815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.965083] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.965853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.099035] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: UNINITIALIZED for 2s [ 740.212204] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.212789] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.212789] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.212789] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.212911] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.213892] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port a32f36ce-7784-443e-8509-b399c02e826e not found, creating... [ 740.213892] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.213892] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.214101] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.214294] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.215266] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.215266] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.215266] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.217551] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.217551] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.217551] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.217732] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: a32f36ce-7784-443e-8509-b399c02e826e is going to be created. [ 740.248112] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.248276] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.248454] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.248782] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.249875] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.249875] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-a32f36ce-7784-443e-8509-b399c02e826e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.441827] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: SUCCESS [ 740.442396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.442615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.443058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.443144] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.733292] env[70535]: INFO networking_nsxv3.common.synchronization [None req-0918ba0c-5f22-4c68-93ea-0a2530f9a99f None None] Enqueued Resource ID: 5d1f828e-9478-4fa1-97af-ef2697545a79 with Priority: HIGHEST for action port [ 740.733854] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d1f828e-9478-4fa1-97af-ef2697545a79 with Priority: HIGHEST for action port [ 740.734212] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d1f828e-9478-4fa1-97af-ef2697545a79 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.735579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d1f828e-9478-4fa1-97af-ef2697545a79" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.735658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d1f828e-9478-4fa1-97af-ef2697545a79" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.737736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d1f828e-9478-4fa1-97af-ef2697545a79" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.737736] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d1f828e-9478-4fa1-97af-ef2697545a79',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.946785] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.946914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.946986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.947468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.947468] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.947468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.947614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.947700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.947779] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.947873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.947965] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.118021] env[70535]: INFO networking_nsxv3.common.synchronization [req-0e3419f9-d5b8-48e9-a4d8-ccedc037246c req-05106501-bdb9-4617-9edf-03af3258139c tempest-AttachInterfacesUnderV243Test-1177928744 tempest-AttachInterfacesUnderV243Test-1177928744-project-member] Enqueued Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_members [ 741.118021] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_members [ 741.118021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf92eefc-a553-4c8e-a807-3110974b4799 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.118021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.118021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.120089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.120360] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.120519] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.120603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.120827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.120936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.121063] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.153340] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec60a8db-faf5-42bd-94a8-662a5418627b in Status: SUCCESS [ 741.153525] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec60a8db-faf5-42bd-94a8-662a5418627b deletion is rescheduled due to dependency. [ 741.153830] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.239930] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d1f828e-9478-4fa1-97af-ef2697545a79 [ 741.240331] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.240513] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.240594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.240934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.241492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.241650] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d1f828e-9478-4fa1-97af-ef2697545a79 already deleted. [ 741.242608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d1f828e-9478-4fa1-97af-ef2697545a79" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.289722] env[70535]: INFO networking_nsxv3.common.synchronization [req-eaa75b93-7c8c-47b6-8fb5-67eddac4cd30 req-3b4661ed-fee0-4716-8d12-1ace7e11a559 tempest-ListServersNegativeTestJSON-1092584325 tempest-ListServersNegativeTestJSON-1092584325-project-member] Enqueued Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 741.290297] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 741.290884] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.291526] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.291789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.293079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.293286] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.294454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.294579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.294918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.295076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.295214] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.339161] env[70535]: INFO networking_nsxv3.common.synchronization [req-57406f42-cc79-4881-a325-eda3bc2a8513 req-5a309dec-bea9-4c87-86f5-b883b617ae5f service nova] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_rules [ 741.339442] env[70535]: INFO networking_nsxv3.common.synchronization [req-57406f42-cc79-4881-a325-eda3bc2a8513 req-5a309dec-bea9-4c87-86f5-b883b617ae5f service nova] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 741.339595] env[70535]: INFO networking_nsxv3.common.synchronization [req-57406f42-cc79-4881-a325-eda3bc2a8513 req-5a309dec-bea9-4c87-86f5-b883b617ae5f service nova] Enqueued Resource ID: a32f36ce-7784-443e-8509-b399c02e826e with Priority: HIGHEST for action port [ 741.340038] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_rules [ 741.340038] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 741.340506] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a32f36ce-7784-443e-8509-b399c02e826e with Priority: HIGHEST for action port [ 741.344857] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.345096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.345217] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.345308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.345503] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-a32f36ce-7784-443e-8509-b399c02e826e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.345668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a32f36ce-7784-443e-8509-b399c02e826e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.345668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a32f36ce-7784-443e-8509-b399c02e826e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.345913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a32f36ce-7784-443e-8509-b399c02e826e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.345977] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a32f36ce-7784-443e-8509-b399c02e826e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.454747] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.454747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.627059] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.627059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.627059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.627253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.627253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.627419] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.627518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.627579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.627752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.627839] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.627936] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf92eefc-a553-4c8e-a807-3110974b4799 already deleted. [ 741.628027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.673654] env[70535]: INFO networking_nsxv3.common.synchronization [None req-7ed10162-a1d6-4ff8-8f66-8e13046b5c8e None None] Enqueued Resource ID: 313f2fc6-972d-4521-a59b-cc97236be66b with Priority: HIGHEST for action port [ 741.674805] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 313f2fc6-972d-4521-a59b-cc97236be66b with Priority: HIGHEST for action port [ 741.675262] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-313f2fc6-972d-4521-a59b-cc97236be66b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.675451] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-313f2fc6-972d-4521-a59b-cc97236be66b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.675516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-313f2fc6-972d-4521-a59b-cc97236be66b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.676246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-313f2fc6-972d-4521-a59b-cc97236be66b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.676338] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('313f2fc6-972d-4521-a59b-cc97236be66b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.798030] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.850643] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a32f36ce-7784-443e-8509-b399c02e826e with status ACTIVE [ 741.853021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.853021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.853021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.853021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.853021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.853021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.853021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.853021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.853021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.853021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.853021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.853021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.853021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.853021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.853021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.853021] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a32f36ce-7784-443e-8509-b399c02e826e is going to be updated. [ 741.889381] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.889521] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.889592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.889806] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.892308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.892308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a32f36ce-7784-443e-8509-b399c02e826e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.054243] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.054243] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-154" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.054371] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-154" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.054619] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-154" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.054879] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.057601] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.057808] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.058110] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.058297] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.058545] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.058662] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.058770] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.058876] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.059065] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.059117] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.059225] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.083553] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.083736] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 742.083872] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.084114] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-154" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.084451] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-601c9f06-1cc1-4e4d-8b6f-763d07559dad taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.084623] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.084740] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.085119] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.085277] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('601c9f06-1cc1-4e4d-8b6f-763d07559dad',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.109279] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 742.109467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.110013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.110247] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.110438] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.110557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.110623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.110773] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.110879] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.110984] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.179054] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 313f2fc6-972d-4521-a59b-cc97236be66b [ 742.179288] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.179430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.179430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.179879] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.179879] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.179879] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:313f2fc6-972d-4521-a59b-cc97236be66b already deleted. [ 742.179979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-313f2fc6-972d-4521-a59b-cc97236be66b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.301034] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.589506] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.590652] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.590652] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.590652] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.590652] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.590652] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 601c9f06-1cc1-4e4d-8b6f-763d07559dad not found, creating... [ 742.590910] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.593106] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.593309] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.593590] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.593737] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.594118] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.594293] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.594411] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.594633] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.594769] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.594915] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 601c9f06-1cc1-4e4d-8b6f-763d07559dad is going to be created. [ 742.616639] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.617821] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.618063] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.618149] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.618408] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.618624] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.618836] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.807235] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.811425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.811425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.811425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.811425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.811425] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00628945-9b3d-4cd6-939f-483e37c62dbe is going to be updated. [ 742.843367] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.843367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.843367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.843367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.843367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.850560] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: IN_PROGRESS for 2s [ 743.123450] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.593148] env[70535]: INFO networking_nsxv3.common.synchronization [req-0e3419f9-d5b8-48e9-a4d8-ccedc037246c req-136a6a93-0961-4e6c-8adf-78b329195cad service nova] Enqueued Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_rules [ 743.593364] env[70535]: INFO networking_nsxv3.common.synchronization [req-0e3419f9-d5b8-48e9-a4d8-ccedc037246c req-136a6a93-0961-4e6c-8adf-78b329195cad service nova] Enqueued Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_members [ 743.593505] env[70535]: INFO networking_nsxv3.common.synchronization [req-0e3419f9-d5b8-48e9-a4d8-ccedc037246c req-136a6a93-0961-4e6c-8adf-78b329195cad service nova] Enqueued Resource ID: 601c9f06-1cc1-4e4d-8b6f-763d07559dad with Priority: HIGHEST for action port [ 743.594415] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_rules [ 743.594604] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_members [ 743.594671] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 601c9f06-1cc1-4e4d-8b6f-763d07559dad with Priority: HIGHEST for action port [ 743.594958] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf92eefc-a553-4c8e-a807-3110974b4799 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.595134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.595187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.595397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.595471] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.596815] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf92eefc-a553-4c8e-a807-3110974b4799 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.596976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.597015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.597334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.597507] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.597609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.597680] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.597829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.597998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.598442] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.599060] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-601c9f06-1cc1-4e4d-8b6f-763d07559dad taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.599210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.599303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.599491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.599906] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('601c9f06-1cc1-4e4d-8b6f-763d07559dad',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.626653] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.626858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.626913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.627694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.627694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.627694] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be updated. [ 743.666068] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.666285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.666335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.666520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.666680] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.678574] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: IN_PROGRESS for 2s [ 744.105022] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 601c9f06-1cc1-4e4d-8b6f-763d07559dad with status ACTIVE [ 744.105022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.105022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.105022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.105022] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 601c9f06-1cc1-4e4d-8b6f-763d07559dad is going to be updated. [ 744.107575] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.108916] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf92eefc-a553-4c8e-a807-3110974b4799 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.109214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.137920] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.138235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.138235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.140615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.140615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.140615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.457141] env[70535]: INFO networking_nsxv3.common.synchronization [None req-73afe109-7cbc-44f2-8546-b75a8cc37220 None None] Enqueued Resource ID: 23125432-1d70-4398-82fc-966c42d3e10f with Priority: HIGHEST for action port [ 744.457758] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23125432-1d70-4398-82fc-966c42d3e10f with Priority: HIGHEST for action port [ 744.458139] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-23125432-1d70-4398-82fc-966c42d3e10f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.458290] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23125432-1d70-4398-82fc-966c42d3e10f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.458379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23125432-1d70-4398-82fc-966c42d3e10f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.458659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23125432-1d70-4398-82fc-966c42d3e10f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.458740] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23125432-1d70-4398-82fc-966c42d3e10f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.612923] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.862725] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: SUCCESS [ 744.863074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.863249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.863461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.863633] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.863759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.867090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.867090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.867090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.867090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.867090] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.867090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.867090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.867090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.867090] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.867090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.867090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.867090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.867090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.867090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.867090] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.961542] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23125432-1d70-4398-82fc-966c42d3e10f [ 744.961901] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.962000] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.962090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.962581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.962581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.962957] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23125432-1d70-4398-82fc-966c42d3e10f already deleted. [ 744.967270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23125432-1d70-4398-82fc-966c42d3e10f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.120086] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.120086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.120086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.120086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.120086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.120086] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf92eefc-a553-4c8e-a807-3110974b4799 is going to be created. [ 745.155967] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.155967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.155967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.155967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.155967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.167632] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf92eefc-a553-4c8e-a807-3110974b4799 in Status: UNINITIALIZED for 2s [ 745.371487] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00628945-9b3d-4cd6-939f-483e37c62dbe: rpc.has_security_group_logging(os_id): False [ 745.392204] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.392624] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.392697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.393254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.393579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.394161] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.394161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.394295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.394531] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.394712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.394967] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.395156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.395254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.395480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.396555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.396821] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.399033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.399033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.399033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.399033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.399033] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00628945-9b3d-4cd6-939f-483e37c62dbe is going to be updated. [ 745.489816] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.490346] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.490426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.490702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.490958] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.509807] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: IN_PROGRESS for 2s [ 745.694186] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 745.694559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.694637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.694853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.695067] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.695181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.695242] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.695405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.695487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.695570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.695664] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.696642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.696837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.697015] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.697127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.697187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.697564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.697564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.697564] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.991279] env[70535]: INFO networking_nsxv3.common.synchronization [req-2896c3af-7c9d-4427-8d6d-0b70e3dc652e req-83052d30-0b36-441e-9aca-9d78081081b1 tempest-ServerAddressesNegativeTestJSON-6836579 tempest-ServerAddressesNegativeTestJSON-6836579-project-member] Enqueued Resource ID: 943c9a56-84a0-4361-a030-eef87cb00d31 with Priority: HIGHEST for action security_group_members [ 745.991279] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943c9a56-84a0-4361-a030-eef87cb00d31 with Priority: HIGHEST for action security_group_members [ 745.991279] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-943c9a56-84a0-4361-a030-eef87cb00d31 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.991279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.991279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.992157] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.992257] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.992683] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.992683] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.993073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.993403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.993664] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('943c9a56-84a0-4361-a030-eef87cb00d31',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.202243] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.202243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.202654] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.499788] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.499788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.499788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.500612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.500612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.500612] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.500612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.500612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.501189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.501189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.501189] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 943c9a56-84a0-4361-a030-eef87cb00d31 already deleted. [ 746.501189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.620392] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-837 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.620586] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-837" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.620708] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-837" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.621096] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-837" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.621370] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.621573] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.621640] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.621862] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.622011] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.622239] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.622348] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.622606] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.622606] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.622682] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.622750] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.622981] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.648284] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.648868] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 746.649399] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.650088] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-837" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.650739] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-aff9a33d-6662-4b14-89dd-e0e3c203a5ab taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.653000] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-aff9a33d-6662-4b14-89dd-e0e3c203a5ab" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.653000] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-aff9a33d-6662-4b14-89dd-e0e3c203a5ab" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.653000] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-aff9a33d-6662-4b14-89dd-e0e3c203a5ab" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.653000] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aff9a33d-6662-4b14-89dd-e0e3c203a5ab',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.675674] env[70535]: INFO networking_nsxv3.common.synchronization [None req-ad590c62-b9d8-47fc-81dd-1d9445d2c4d3 tempest-ServersTestBootFromVolume-979772703 tempest-ServersTestBootFromVolume-979772703-project-member] Enqueued Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGHEST for action security_group_rules [ 746.676675] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGHEST for action security_group_rules [ 746.677545] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b11bca7-ad54-4a56-a651-3a19b70ab917 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.677987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.678070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.678436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.678602] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b11bca7-ad54-4a56-a651-3a19b70ab917',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.705295] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.793776] env[70535]: INFO networking_nsxv3.common.synchronization [None req-ebc6bea6-2e9e-4290-bebd-c898c9bc9c1a None None] Enqueued Resource ID: ac6164e1-f8df-42ae-b5f2-76e67e2e9221 with Priority: HIGHEST for action port [ 746.794089] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac6164e1-f8df-42ae-b5f2-76e67e2e9221 with Priority: HIGHEST for action port [ 746.794726] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac6164e1-f8df-42ae-b5f2-76e67e2e9221 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.794799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac6164e1-f8df-42ae-b5f2-76e67e2e9221" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.794846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac6164e1-f8df-42ae-b5f2-76e67e2e9221" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.797184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac6164e1-f8df-42ae-b5f2-76e67e2e9221" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.803310] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac6164e1-f8df-42ae-b5f2-76e67e2e9221',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.809509] env[70535]: INFO networking_nsxv3.common.synchronization [None req-555a4a17-2dd1-440c-9a5c-57034c0fa322 tempest-ServersTestBootFromVolume-979772703 tempest-ServersTestBootFromVolume-979772703-project-member] Enqueued Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGHEST for action security_group_rules [ 746.809509] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGHEST for action security_group_rules [ 746.809509] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b11bca7-ad54-4a56-a651-3a19b70ab917 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.809509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.159751] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.159751] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.159751] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.159751] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.159751] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.159751] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port aff9a33d-6662-4b14-89dd-e0e3c203a5ab not found, creating... [ 747.159751] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.159751] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.160260] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.160513] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.160601] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.163703] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.164019] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.164804] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.165239] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.165575] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.165767] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: aff9a33d-6662-4b14-89dd-e0e3c203a5ab is going to be created. [ 747.178383] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf92eefc-a553-4c8e-a807-3110974b4799 in Status: SUCCESS [ 747.179342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.179342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.179342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.179600] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.179600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.179600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.179752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.179831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.180036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.180197] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.190418] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.190656] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.190793] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.191316] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.191399] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.191610] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-aff9a33d-6662-4b14-89dd-e0e3c203a5ab" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.203761] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.204466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.204466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.204466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.204466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.204466] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 already deleted. [ 747.204656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.204656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.204791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.204869] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b11bca7-ad54-4a56-a651-3a19b70ab917',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.207461] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.207606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.207648] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.207844] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.207905] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.207960] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be updated. [ 747.241648] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.241809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.241973] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.242146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.242312] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.266178] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: IN_PROGRESS for 2s [ 747.310180] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac6164e1-f8df-42ae-b5f2-76e67e2e9221 [ 747.310456] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.310456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.310968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.310968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.310968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.310968] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac6164e1-f8df-42ae-b5f2-76e67e2e9221 already deleted. [ 747.311292] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac6164e1-f8df-42ae-b5f2-76e67e2e9221" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.522342] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: SUCCESS [ 747.522790] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.523066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.523312] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.523436] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.684407] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.730968] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.730968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.730968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.730968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.730968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.730968] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 already deleted. [ 747.730968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.026234] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.026234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.026234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.026234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.027218] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.027218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.027218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.027218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.027218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.027218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.027462] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.188069] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf92eefc-a553-4c8e-a807-3110974b4799: rpc.has_security_group_logging(os_id): False [ 748.210249] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.210593] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.210593] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.210710] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.210771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.211044] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.211145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.211194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.212945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.212945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.212945] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf92eefc-a553-4c8e-a807-3110974b4799 is going to be created. [ 748.300063] env[70535]: INFO networking_nsxv3.common.synchronization [req-2896c3af-7c9d-4427-8d6d-0b70e3dc652e req-59fb8afb-f826-4c6c-a48a-1b27a53722a6 service nova] Enqueued Resource ID: 943c9a56-84a0-4361-a030-eef87cb00d31 with Priority: HIGHEST for action security_group_rules [ 748.300372] env[70535]: INFO networking_nsxv3.common.synchronization [req-2896c3af-7c9d-4427-8d6d-0b70e3dc652e req-59fb8afb-f826-4c6c-a48a-1b27a53722a6 service nova] Enqueued Resource ID: 943c9a56-84a0-4361-a030-eef87cb00d31 with Priority: HIGHEST for action security_group_members [ 748.302624] env[70535]: INFO networking_nsxv3.common.synchronization [req-2896c3af-7c9d-4427-8d6d-0b70e3dc652e req-59fb8afb-f826-4c6c-a48a-1b27a53722a6 service nova] Enqueued Resource ID: aff9a33d-6662-4b14-89dd-e0e3c203a5ab with Priority: HIGHEST for action port [ 748.306327] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943c9a56-84a0-4361-a030-eef87cb00d31 with Priority: HIGHEST for action security_group_rules [ 748.306327] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943c9a56-84a0-4361-a030-eef87cb00d31 with Priority: HIGHEST for action security_group_members [ 748.306327] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aff9a33d-6662-4b14-89dd-e0e3c203a5ab with Priority: HIGHEST for action port [ 748.306327] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.308099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.308697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.313230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.313441] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.314858] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-943c9a56-84a0-4361-a030-eef87cb00d31 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.314979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.315055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.315305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.315390] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('943c9a56-84a0-4361-a030-eef87cb00d31',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.319556] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-943c9a56-84a0-4361-a030-eef87cb00d31 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.319556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.319556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.319556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.319556] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.319556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.319556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.319556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.319556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.319556] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('943c9a56-84a0-4361-a030-eef87cb00d31',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.319556] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-aff9a33d-6662-4b14-89dd-e0e3c203a5ab taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.320164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aff9a33d-6662-4b14-89dd-e0e3c203a5ab" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.320164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aff9a33d-6662-4b14-89dd-e0e3c203a5ab" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.320278] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aff9a33d-6662-4b14-89dd-e0e3c203a5ab" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.320394] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aff9a33d-6662-4b14-89dd-e0e3c203a5ab',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.338246] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf92eefc-a553-4c8e-a807-3110974b4799 in Status: IN_PROGRESS for 2s [ 748.534660] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.534835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.534919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.535172] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.535409] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.535545] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.535681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.535759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.537386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.537564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.537803] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.537921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.538037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.538172] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.538329] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.538428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.538486] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.538629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.538713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.538796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.538886] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.784160] env[70535]: INFO networking_nsxv3.common.synchronization [req-5384cd0a-c805-4396-8b7b-7b1d5697dc52 req-29c30ad5-cb91-415f-8d10-a22a36b409df tempest-ServersV294TestFqdnHostnames-734776706 tempest-ServersV294TestFqdnHostnames-734776706-project-member] Enqueued Resource ID: ce0ae195-bd66-418b-89e1-33b9dece1034 with Priority: HIGHEST for action security_group_members [ 748.784785] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce0ae195-bd66-418b-89e1-33b9dece1034 with Priority: HIGHEST for action security_group_members [ 748.785193] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce0ae195-bd66-418b-89e1-33b9dece1034 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.785384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.785483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.785776] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.785986] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.786161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.786279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.786486] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.786623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.786755] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce0ae195-bd66-418b-89e1-33b9dece1034',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.822870] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aff9a33d-6662-4b14-89dd-e0e3c203a5ab with status ACTIVE [ 748.823188] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.823328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.823394] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.823600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.826861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.826861] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.826861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.826861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.826861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.826861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.826861] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.826861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.826861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.826861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.826861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.826861] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aff9a33d-6662-4b14-89dd-e0e3c203a5ab is going to be updated. [ 748.826861] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-943c9a56-84a0-4361-a030-eef87cb00d31 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.826861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.826861] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('943c9a56-84a0-4361-a030-eef87cb00d31',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.848034] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.849328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.849502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.849814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.850020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.850267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aff9a33d-6662-4b14-89dd-e0e3c203a5ab" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.043496] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00628945-9b3d-4cd6-939f-483e37c62dbe: rpc.has_security_group_logging(os_id): False [ 749.065652] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.065811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.065882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.066156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.066269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.066570] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.066677] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.066749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.066919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.066997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.067279] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.067363] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.067422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.067621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.067704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.067949] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.068231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.068319] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.068469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.068544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.068626] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00628945-9b3d-4cd6-939f-483e37c62dbe is going to be updated. [ 749.138466] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.138650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.138650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.138850] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.138991] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.151649] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: IN_PROGRESS for 2s [ 749.277335] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 749.277335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.277335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.277335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.277335] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.277335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.277335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.277335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.277335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.277855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.277855] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.277855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.277855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.277855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.278035] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.278517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.278634] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.278788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.278866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.278948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.279061] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.289290] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.289424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.289492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.289706] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.289807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.289984] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.290109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.290159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.290305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.290376] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.290790] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce0ae195-bd66-418b-89e1-33b9dece1034 already deleted. [ 749.291170] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.329537] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('943c9a56-84a0-4361-a030-eef87cb00d31',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.415705] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.415955] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-988" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.416371] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-988" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.416803] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-988" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.418536] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.419459] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.419459] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.419657] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.420104] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.420442] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.420553] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.420797] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.421083] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.421336] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.421581] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.421860] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.445327] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.445506] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 749.445646] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.445834] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-988" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.446174] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-633b3038-0cf7-4ee5-9136-26061f357491 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.446355] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-633b3038-0cf7-4ee5-9136-26061f357491" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.446476] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-633b3038-0cf7-4ee5-9136-26061f357491" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.446826] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-633b3038-0cf7-4ee5-9136-26061f357491" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.446970] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('633b3038-0cf7-4ee5-9136-26061f357491',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.783131] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f32aa9cd-fe8f-4b69-8037-59fa1cf6570c: rpc.has_security_group_logging(os_id): False [ 749.806493] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.807041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.808543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.808543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.808543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.808543] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.808543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.808543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.808543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.808543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.808543] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.808543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.808873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.809643] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.809643] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.809643] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.809960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.810051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.810256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.810395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.810554] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be created. [ 749.832702] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.832847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.832926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.833201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.833335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.833477] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 943c9a56-84a0-4361-a030-eef87cb00d31 is going to be created. [ 749.860120] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.860291] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.860364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.860612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.860800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.879133] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 943c9a56-84a0-4361-a030-eef87cb00d31 in Status: UNINITIALIZED for 2s [ 749.895402] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.895573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.895612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.895940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.896262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.911106] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: IN_PROGRESS for 2s [ 749.949626] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.949938] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.950134] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.950527] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.950633] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.950816] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 633b3038-0cf7-4ee5-9136-26061f357491 not found, creating... [ 749.951222] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.951451] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.951564] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.951897] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.952075] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.952446] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.952646] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.952771] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.953113] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.953298] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.953509] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 633b3038-0cf7-4ee5-9136-26061f357491 is going to be created. [ 749.978637] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.978898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.979049] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.979338] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.979606] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.979851] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-633b3038-0cf7-4ee5-9136-26061f357491" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.352757] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf92eefc-a553-4c8e-a807-3110974b4799 in Status: SUCCESS [ 750.353421] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.980677] env[70535]: INFO networking_nsxv3.common.synchronization [req-5384cd0a-c805-4396-8b7b-7b1d5697dc52 req-a7f3c98a-f1ec-46fc-b9c1-8c119d553345 service nova] Enqueued Resource ID: ce0ae195-bd66-418b-89e1-33b9dece1034 with Priority: HIGHEST for action security_group_rules [ 750.980677] env[70535]: INFO networking_nsxv3.common.synchronization [req-5384cd0a-c805-4396-8b7b-7b1d5697dc52 req-a7f3c98a-f1ec-46fc-b9c1-8c119d553345 service nova] Enqueued Resource ID: ce0ae195-bd66-418b-89e1-33b9dece1034 with Priority: HIGHEST for action security_group_members [ 750.980677] env[70535]: INFO networking_nsxv3.common.synchronization [req-5384cd0a-c805-4396-8b7b-7b1d5697dc52 req-a7f3c98a-f1ec-46fc-b9c1-8c119d553345 service nova] Enqueued Resource ID: 633b3038-0cf7-4ee5-9136-26061f357491 with Priority: HIGHEST for action port [ 750.981484] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce0ae195-bd66-418b-89e1-33b9dece1034 with Priority: HIGHEST for action security_group_rules [ 750.981484] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce0ae195-bd66-418b-89e1-33b9dece1034 with Priority: HIGHEST for action security_group_members [ 750.981484] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 633b3038-0cf7-4ee5-9136-26061f357491 with Priority: HIGHEST for action port [ 750.981729] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce0ae195-bd66-418b-89e1-33b9dece1034 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.981855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.981920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.982148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.982817] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce0ae195-bd66-418b-89e1-33b9dece1034',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.983110] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce0ae195-bd66-418b-89e1-33b9dece1034 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.983233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.983297] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.983591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.983657] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.983871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.983871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.983931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.983970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.984070] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce0ae195-bd66-418b-89e1-33b9dece1034',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.985228] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-633b3038-0cf7-4ee5-9136-26061f357491 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.985484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-633b3038-0cf7-4ee5-9136-26061f357491" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.985484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-633b3038-0cf7-4ee5-9136-26061f357491" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.985572] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-633b3038-0cf7-4ee5-9136-26061f357491" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.985646] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('633b3038-0cf7-4ee5-9136-26061f357491',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.136740] env[70535]: INFO networking_nsxv3.common.synchronization [req-24f9e051-26c4-4540-8457-b1c12d90b8c1 req-657cfed8-0984-4f67-9855-1eb373dc9707 tempest-FloatingIPsAssociationTestJSON-570582915 tempest-FloatingIPsAssociationTestJSON-570582915-project-member] Enqueued Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_members [ 751.137321] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_members [ 751.137633] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.137773] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.137842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.139177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.139252] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.139486] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.139486] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.139647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.139757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.139859] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.163800] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: SUCCESS [ 751.164623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.486857] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce0ae195-bd66-418b-89e1-33b9dece1034',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.488486] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce0ae195-bd66-418b-89e1-33b9dece1034 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.488599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.488812] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 633b3038-0cf7-4ee5-9136-26061f357491 with status ACTIVE [ 751.488982] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.489099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.489168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.489410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.489505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.489676] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.489775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.489837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.489997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.490293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.490502] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.490613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.490681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.490842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.490918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.491049] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 633b3038-0cf7-4ee5-9136-26061f357491 is going to be updated. [ 751.526076] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.526337] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.527221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.527221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.527221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.527221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-633b3038-0cf7-4ee5-9136-26061f357491" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.643526] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.889699] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 943c9a56-84a0-4361-a030-eef87cb00d31 in Status: SUCCESS [ 751.889918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.890114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.890344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.890536] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.890654] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.890722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.890873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.890964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.891100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.891281] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('943c9a56-84a0-4361-a030-eef87cb00d31',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.925904] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 751.926154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.926333] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.926547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.926634] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.992943] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce0ae195-bd66-418b-89e1-33b9dece1034',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.147258] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.394397] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-943c9a56-84a0-4361-a030-eef87cb00d31 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.394480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.394560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.394828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.395151] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.395788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.395788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.395788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.395788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.395788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.396079] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-943c9a56-84a0-4361-a030-eef87cb00d31 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.396224] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.396281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.396618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.396618] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.396716] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.396716] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.396864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.396990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.397114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.397230] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('943c9a56-84a0-4361-a030-eef87cb00d31',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.428797] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.429020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.429257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.429404] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.429934] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.429934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.429934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.429934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.430070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.430070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.430526] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.495529] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.495854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.495854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.496744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.496744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.496744] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce0ae195-bd66-418b-89e1-33b9dece1034 is going to be created. [ 752.521731] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.522999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.523163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.523795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.524033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.535118] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce0ae195-bd66-418b-89e1-33b9dece1034 in Status: UNINITIALIZED for 2s [ 752.649134] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.649134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.649134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.649327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.649485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.649601] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b34086e-8eac-4499-9c02-2280b24b0698 is going to be updated. [ 752.680937] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.680937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.680937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.680937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.680937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.690095] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: IN_PROGRESS for 2s [ 752.901020] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 943c9a56-84a0-4361-a030-eef87cb00d31: rpc.has_security_group_logging(os_id): False [ 752.918440] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.918591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.918669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.918879] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.918972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.919198] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.919300] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.919363] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.919512] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.919589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.919779] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.919929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.920046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.920203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.920283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.920527] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.920629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.920690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.920833] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.920909] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.920995] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 943c9a56-84a0-4361-a030-eef87cb00d31 is going to be created. [ 752.932025] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.932254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.932314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.932526] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.933181] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.933181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.933181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.933181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.933181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.933378] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.933378] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.933453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.933528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.933676] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.933820] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.933913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.933973] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.934135] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.934294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.934294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.934390] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.984327] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.984506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.984578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.984808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.985024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.997957] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 943c9a56-84a0-4361-a030-eef87cb00d31 in Status: IN_PROGRESS for 2s [ 753.437862] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f32aa9cd-fe8f-4b69-8037-59fa1cf6570c: rpc.has_security_group_logging(os_id): False [ 753.455663] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.455823] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.455887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.456120] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.456431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.456431] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.456553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.456586] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.456949] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.456949] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.457051] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.458075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.458075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.458075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.458075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.458075] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.458075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.458075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.458075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.458075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.458075] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be updated. [ 753.540766] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.541176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.541176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.541361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.541482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.557030] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: IN_PROGRESS for 2s [ 754.549545] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce0ae195-bd66-418b-89e1-33b9dece1034 in Status: SUCCESS [ 754.549937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.549981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.550573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.550573] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.550573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.550573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.550779] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.550807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.550929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.551183] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce0ae195-bd66-418b-89e1-33b9dece1034',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.700871] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: SUCCESS [ 754.701277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.011475] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 943c9a56-84a0-4361-a030-eef87cb00d31 in Status: SUCCESS [ 755.011475] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.053465] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce0ae195-bd66-418b-89e1-33b9dece1034',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.557042] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce0ae195-bd66-418b-89e1-33b9dece1034: rpc.has_security_group_logging(os_id): False [ 755.574067] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 755.574334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.575237] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.575520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.575520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.575749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.575846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.576141] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.576261] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.576323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.576487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.576569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.576657] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce0ae195-bd66-418b-89e1-33b9dece1034 is going to be created. [ 755.648880] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.649046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.649109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.649388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.649501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.661322] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce0ae195-bd66-418b-89e1-33b9dece1034 in Status: IN_PROGRESS for 2s [ 756.138222] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 756.138511] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 757.695522] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce0ae195-bd66-418b-89e1-33b9dece1034 in Status: SUCCESS [ 757.696538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.211436] env[70535]: INFO networking_nsxv3.common.synchronization [None req-22f54442-e2c0-45ac-9e8f-38c23eff70a5 None None] Enqueued Resource ID: a859c5d2-7609-4f23-a36b-6cf128ce9a33 with Priority: HIGHEST for action port [ 758.211996] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a859c5d2-7609-4f23-a36b-6cf128ce9a33 with Priority: HIGHEST for action port [ 758.212338] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-a859c5d2-7609-4f23-a36b-6cf128ce9a33 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.212478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a859c5d2-7609-4f23-a36b-6cf128ce9a33" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.212553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a859c5d2-7609-4f23-a36b-6cf128ce9a33" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.214375] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a859c5d2-7609-4f23-a36b-6cf128ce9a33" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.215102] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a859c5d2-7609-4f23-a36b-6cf128ce9a33',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.719653] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a859c5d2-7609-4f23-a36b-6cf128ce9a33 [ 758.719961] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.720088] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.720147] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.720337] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.720428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.720993] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a859c5d2-7609-4f23-a36b-6cf128ce9a33 already deleted. [ 758.720993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a859c5d2-7609-4f23-a36b-6cf128ce9a33" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.229567] env[70535]: INFO networking_nsxv3.common.synchronization [req-66853e58-349e-4554-8f41-93abc90ab8cc req-d7c639a4-3030-42b6-8fc5-39f05d31dba6 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 760.230385] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 760.230592] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.230761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.230813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.231972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.234965] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.234965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.234965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.234965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.234965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.234965] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.666533] env[70535]: INFO networking_nsxv3.common.synchronization [None req-a2f96b60-19cd-4507-a570-c78107fe5c2b None None] Enqueued Resource ID: cc135b41-75f7-4c55-85d3-a383b0fd0c80 with Priority: HIGHEST for action port [ 760.666874] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc135b41-75f7-4c55-85d3-a383b0fd0c80 with Priority: HIGHEST for action port [ 760.667478] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc135b41-75f7-4c55-85d3-a383b0fd0c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.667634] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc135b41-75f7-4c55-85d3-a383b0fd0c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.667742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc135b41-75f7-4c55-85d3-a383b0fd0c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.667960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc135b41-75f7-4c55-85d3-a383b0fd0c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.668267] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc135b41-75f7-4c55-85d3-a383b0fd0c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.737847] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.739039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.739039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.739039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.739039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.739039] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.739039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.739306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.739426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.739545] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.739690] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 already deleted. [ 760.739785] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.774849] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.775068] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-353" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.775197] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-353" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.775578] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-353" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.775853] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.776128] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.776128] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.776351] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.776499] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.776740] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 760.776864] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.776978] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.777034] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.777152] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 760.777257] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.777389] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.801272] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.801272] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 760.801272] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.801272] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-353" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.801272] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.801272] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.801272] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.801272] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.801272] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df7283b1-7d51-470e-b7a4-7b3425c1c0a9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.171031] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc135b41-75f7-4c55-85d3-a383b0fd0c80 [ 761.171782] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.171782] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.171782] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.172028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.172131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.172205] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc135b41-75f7-4c55-85d3-a383b0fd0c80 already deleted. [ 761.172249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc135b41-75f7-4c55-85d3-a383b0fd0c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.308023] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.308023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.308023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.308023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.308023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.308023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port df7283b1-7d51-470e-b7a4-7b3425c1c0a9 not found, creating... [ 761.308023] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.308023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.308023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.308023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.308023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.308671] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.308883] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.309180] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.309526] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.310220] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.310220] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: df7283b1-7d51-470e-b7a4-7b3425c1c0a9 is going to be created. [ 761.339181] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.339920] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.339920] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.340207] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.340207] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.341158] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.519201] env[70535]: INFO networking_nsxv3.common.synchronization [req-f97789b7-23b0-42a7-a910-246c897ebff4 req-0b38b471-3650-4210-a211-f1815f04a820 tempest-ServerAddressesNegativeTestJSON-6836579 tempest-ServerAddressesNegativeTestJSON-6836579-project-member] Enqueued Resource ID: 943c9a56-84a0-4361-a030-eef87cb00d31 with Priority: HIGHEST for action security_group_members [ 761.520752] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943c9a56-84a0-4361-a030-eef87cb00d31 with Priority: HIGHEST for action security_group_members [ 761.520752] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-943c9a56-84a0-4361-a030-eef87cb00d31 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.520752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.520752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.521274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.521274] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.521274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.521274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.521480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.521480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.521535] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('943c9a56-84a0-4361-a030-eef87cb00d31',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.026466] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.026466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.026466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.026466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.026466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.026466] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.026466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.026466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.026466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.026466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.026466] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 943c9a56-84a0-4361-a030-eef87cb00d31 is going to be updated. [ 762.056516] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.056516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.056516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.056516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.056516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.066035] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 943c9a56-84a0-4361-a030-eef87cb00d31 in Status: IN_PROGRESS for 2s [ 762.109735] env[70535]: INFO networking_nsxv3.common.synchronization [req-66853e58-349e-4554-8f41-93abc90ab8cc req-5de75c71-3556-477f-9f90-97863ccca363 service nova] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_rules [ 762.113021] env[70535]: INFO networking_nsxv3.common.synchronization [req-66853e58-349e-4554-8f41-93abc90ab8cc req-5de75c71-3556-477f-9f90-97863ccca363 service nova] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 762.113021] env[70535]: INFO networking_nsxv3.common.synchronization [req-66853e58-349e-4554-8f41-93abc90ab8cc req-5de75c71-3556-477f-9f90-97863ccca363 service nova] Enqueued Resource ID: df7283b1-7d51-470e-b7a4-7b3425c1c0a9 with Priority: HIGHEST for action port [ 762.113021] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_rules [ 762.113021] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 762.113021] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df7283b1-7d51-470e-b7a4-7b3425c1c0a9 with Priority: HIGHEST for action port [ 762.113021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.113021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.113021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.113021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.113021] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.113021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.113021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.113821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.113821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.113821] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.113821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.113821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.113821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.114212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.114212] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.115045] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.115155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.115212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.115379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.115451] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df7283b1-7d51-470e-b7a4-7b3425c1c0a9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.620490] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.621577] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.622023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.622023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df7283b1-7d51-470e-b7a4-7b3425c1c0a9 with status ACTIVE [ 762.622145] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.622495] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.622495] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.623233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.623233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.623233] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.623233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.623379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.623543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.623543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.623896] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.624253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.624383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.625037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.625037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.625037] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df7283b1-7d51-470e-b7a4-7b3425c1c0a9 is going to be updated. [ 762.655225] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.655225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.655225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.655225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.655225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.655225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.976401] env[70535]: INFO networking_nsxv3.common.synchronization [req-5ef6d698-d28e-4904-bbd0-1a49a5b2488c req-1085dfe8-8b6e-4d74-a67e-a8eb13344fc2 tempest-ServerDiskConfigTestJSON-1021082095 tempest-ServerDiskConfigTestJSON-1021082095-project-member] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 762.977877] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 762.978013] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.978207] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.978279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.978482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.978642] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.978740] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.978800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.978945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.979044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.980034] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.127277] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.411138] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.411344] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.411502] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.411779] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.412051] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.412277] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.412420] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.412650] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.412797] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.413014] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 763.413457] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.413457] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.413457] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.413630] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 763.413754] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.413893] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.437445] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.437641] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 763.437786] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.438021] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.438485] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-8038a338-bfc5-4831-881a-269f74140583 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.438943] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-8038a338-bfc5-4831-881a-269f74140583" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.438943] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-8038a338-bfc5-4831-881a-269f74140583" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.439244] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-8038a338-bfc5-4831-881a-269f74140583" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.439385] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8038a338-bfc5-4831-881a-269f74140583',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.483753] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.483918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.484314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.484314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.484410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.484908] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.484908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.484908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.484908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.485199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.485199] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 763.515035] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.515244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.515244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.515442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.515600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.534503] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 763.631779] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.632198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.632198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.632282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.632365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.632477] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be created. [ 763.660447] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.660447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.660447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.660650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.660820] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.672285] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: UNINITIALIZED for 2s [ 763.941679] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.941896] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.942124] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.942470] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.942655] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.942840] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 8038a338-bfc5-4831-881a-269f74140583 not found, creating... [ 763.943181] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.943529] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.944910] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.944910] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.944910] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.944910] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.944910] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.944910] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.945169] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.945402] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.945684] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 8038a338-bfc5-4831-881a-269f74140583 is going to be created. [ 763.969408] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.969503] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.969569] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.970327] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.970608] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.970790] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-8038a338-bfc5-4831-881a-269f74140583" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.076958] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 943c9a56-84a0-4361-a030-eef87cb00d31 in Status: SUCCESS [ 764.077250] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 943c9a56-84a0-4361-a030-eef87cb00d31 deletion is rescheduled due to dependency. [ 764.077391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.725749] env[70535]: INFO networking_nsxv3.common.synchronization [req-5ef6d698-d28e-4904-bbd0-1a49a5b2488c req-92c28f26-581a-4145-8e71-e557c35d1126 service nova] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_rules [ 764.726035] env[70535]: INFO networking_nsxv3.common.synchronization [req-5ef6d698-d28e-4904-bbd0-1a49a5b2488c req-92c28f26-581a-4145-8e71-e557c35d1126 service nova] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 764.726103] env[70535]: INFO networking_nsxv3.common.synchronization [req-5ef6d698-d28e-4904-bbd0-1a49a5b2488c req-92c28f26-581a-4145-8e71-e557c35d1126 service nova] Enqueued Resource ID: 8038a338-bfc5-4831-881a-269f74140583 with Priority: HIGHEST for action port [ 764.726662] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_rules [ 764.726788] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 764.726900] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8038a338-bfc5-4831-881a-269f74140583 with Priority: HIGHEST for action port [ 764.727183] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.727334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.727429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.727638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.727720] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.728571] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.728691] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.728882] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-8038a338-bfc5-4831-881a-269f74140583 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.728983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8038a338-bfc5-4831-881a-269f74140583" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.729061] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8038a338-bfc5-4831-881a-269f74140583" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.729264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8038a338-bfc5-4831-881a-269f74140583" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.729329] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8038a338-bfc5-4831-881a-269f74140583',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.237532] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.237532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.237532] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8038a338-bfc5-4831-881a-269f74140583 with status ACTIVE [ 765.237532] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.237532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.237532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.237532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.237532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.237832] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.237832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.237896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.238231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.238231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.238456] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.238535] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.238956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.239081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.239180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.239762] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8038a338-bfc5-4831-881a-269f74140583 is going to be updated. [ 765.274294] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.275754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.275754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.275754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.275754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.275754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8038a338-bfc5-4831-881a-269f74140583" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.544032] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 765.544281] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 deletion is rescheduled due to dependency. [ 765.544801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.545038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.545353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.545609] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.545840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.545905] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.546120] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.546243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.546374] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.686256] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 765.686467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.686646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.686870] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.687083] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.687206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.687472] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.687472] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.687568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.687568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.687664] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.740913] env[70535]: INFO networking_nsxv3.common.synchronization [req-fde93aae-c032-4708-827f-cc1b9a7ee72c req-324b7fef-59b6-4ccf-9120-1be31f9dacbf tempest-AttachVolumeShelveTestJSON-2125264447 tempest-AttachVolumeShelveTestJSON-2125264447-project-member] Enqueued Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_members [ 765.741480] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_members [ 765.741866] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c30db4ac-0243-4260-914e-2e6a0283c93a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.742134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.742257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.742703] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.742944] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.743126] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.743334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.743570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.743744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.743915] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.049409] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.191030] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.191030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.191030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.191589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.191957] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.192663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.192663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.192663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.192940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.194058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.194058] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.194058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.194058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.194058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.194058] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.194058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.194508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.194762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.194942] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.195133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.196232] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.200441] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.202032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.202032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.202032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.202032] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.202032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.202032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.202692] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.202947] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.203396] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 766.206018] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.206018] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.206018] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.206018] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 766.206018] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.206018] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.226773] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.226921] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 766.226981] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.227158] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.227521] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.227721] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.227839] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.228179] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.228318] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cebb52c4-6dd6-4c4f-b646-3ba641fc4e66',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.246988] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.246988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.246988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.247217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.247299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.248027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.248027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.248027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.248027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.248027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.248027] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c30db4ac-0243-4260-914e-2e6a0283c93a already deleted. [ 766.248027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.552042] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.697848] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2: rpc.has_security_group_logging(os_id): False [ 766.719055] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.719253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.719367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.719715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.719839] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.720227] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.720403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.720484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.720742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.720865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.721213] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.721399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.721507] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.721724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.721861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.722175] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.722326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.722544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.722714] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.722835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.722981] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be created. [ 766.731704] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.732083] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.732278] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.732700] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.732940] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.733203] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 not found, creating... [ 766.733615] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.733901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.734122] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.734494] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.734730] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.735172] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.735400] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.735582] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.735854] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.736048] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.736247] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 is going to be created. [ 766.771816] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.771816] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.771816] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.773265] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.773265] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.773265] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.852563] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.852563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.852563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.852563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.852729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.866015] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 767.055651] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.055877] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.055980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.056322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.056463] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.056608] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 767.091896] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.092150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.092272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.092600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.092814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.106763] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 767.590224] env[70535]: INFO networking_nsxv3.common.synchronization [req-fde93aae-c032-4708-827f-cc1b9a7ee72c req-41d26a10-82a3-479b-9121-471c233ffc24 service nova] Enqueued Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_rules [ 767.590224] env[70535]: INFO networking_nsxv3.common.synchronization [req-fde93aae-c032-4708-827f-cc1b9a7ee72c req-41d26a10-82a3-479b-9121-471c233ffc24 service nova] Enqueued Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_members [ 767.590224] env[70535]: INFO networking_nsxv3.common.synchronization [req-fde93aae-c032-4708-827f-cc1b9a7ee72c req-41d26a10-82a3-479b-9121-471c233ffc24 service nova] Enqueued Resource ID: cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 with Priority: HIGHEST for action port [ 767.590224] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_rules [ 767.590224] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_members [ 767.590224] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 with Priority: HIGHEST for action port [ 767.590641] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c30db4ac-0243-4260-914e-2e6a0283c93a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.590641] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.590735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.590885] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.590998] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.592609] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c30db4ac-0243-4260-914e-2e6a0283c93a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.592609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.592609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.592609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.592861] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.592861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.592933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.593474] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.593474] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.593474] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.594053] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.594166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.594235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.594413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.594498] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cebb52c4-6dd6-4c4f-b646-3ba641fc4e66',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.096846] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c30db4ac-0243-4260-914e-2e6a0283c93a taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.097186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.097281] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.098175] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 with status ACTIVE [ 768.098371] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.098486] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.098562] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.099223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.099223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.099223] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.099223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.099223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.099597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.099597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.099597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.099716] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.099716] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.099909] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.099909] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.100048] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 is going to be updated. [ 768.125171] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.125289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.125344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.125548] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.125688] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.125855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.472516] env[70535]: INFO networking_nsxv3.common.synchronization [req-10fc32dd-304f-459b-ae36-e80466576276 req-00b66c9a-d821-462a-8142-21ea51ea177a tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 with Priority: HIGHEST for action security_group_members [ 768.473676] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 with Priority: HIGHEST for action security_group_members [ 768.473676] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.476214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.476214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.476214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.476214] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.476214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.476214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.476214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.476214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.476214] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48008d9c-bbf6-40a2-bb47-24eddd9f74c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.602490] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.882528] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 768.882756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.899491] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.899690] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.899814] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.900533] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.900841] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.901955] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.902139] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.902416] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.903219] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.903219] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.903219] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.903219] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.903219] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.904398] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.904398] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.904398] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.923783] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.924000] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 768.924166] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.924386] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.924809] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-1019c59a-40ab-49e8-9caf-665fcc22d1ad taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.924996] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-1019c59a-40ab-49e8-9caf-665fcc22d1ad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.925135] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-1019c59a-40ab-49e8-9caf-665fcc22d1ad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.925576] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-1019c59a-40ab-49e8-9caf-665fcc22d1ad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.925795] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1019c59a-40ab-49e8-9caf-665fcc22d1ad',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.978839] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.979009] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.979131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.979345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.979440] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.979637] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.979738] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.979796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.980216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.980216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.980216] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 already deleted. [ 768.980216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.105459] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.105796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.105859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.106076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.106177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.106629] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c30db4ac-0243-4260-914e-2e6a0283c93a is going to be created. [ 769.123014] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 4s [ 769.138160] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.138337] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.138409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.138720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.138932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.148929] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c30db4ac-0243-4260-914e-2e6a0283c93a in Status: UNINITIALIZED for 2s [ 769.429785] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.430123] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.430323] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.430797] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.431135] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.431327] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 1019c59a-40ab-49e8-9caf-665fcc22d1ad not found, creating... [ 769.431635] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.431837] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.431976] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.432247] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.432489] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.432968] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.433223] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.433414] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.433657] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.433811] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.433990] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 1019c59a-40ab-49e8-9caf-665fcc22d1ad is going to be created. [ 769.456187] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.456471] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.456570] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.456869] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.457123] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.457371] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-1019c59a-40ab-49e8-9caf-665fcc22d1ad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.339787] env[70535]: INFO networking_nsxv3.common.synchronization [req-10fc32dd-304f-459b-ae36-e80466576276 req-b393ca04-9060-4d0b-871a-204b6221bffe service nova] Enqueued Resource ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 with Priority: HIGHEST for action security_group_rules [ 770.339787] env[70535]: INFO networking_nsxv3.common.synchronization [req-10fc32dd-304f-459b-ae36-e80466576276 req-b393ca04-9060-4d0b-871a-204b6221bffe service nova] Enqueued Resource ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 with Priority: HIGHEST for action security_group_members [ 770.339787] env[70535]: INFO networking_nsxv3.common.synchronization [req-10fc32dd-304f-459b-ae36-e80466576276 req-b393ca04-9060-4d0b-871a-204b6221bffe service nova] Enqueued Resource ID: 1019c59a-40ab-49e8-9caf-665fcc22d1ad with Priority: HIGHEST for action port [ 770.343164] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 with Priority: HIGHEST for action security_group_rules [ 770.343164] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 with Priority: HIGHEST for action security_group_members [ 770.343164] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1019c59a-40ab-49e8-9caf-665fcc22d1ad with Priority: HIGHEST for action port [ 770.343164] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.343164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.343164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.343164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.343164] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48008d9c-bbf6-40a2-bb47-24eddd9f74c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.349145] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.349145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.349145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.350483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.351772] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.351772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.351772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.354150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.354150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.354150] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48008d9c-bbf6-40a2-bb47-24eddd9f74c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.355232] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-1019c59a-40ab-49e8-9caf-665fcc22d1ad taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.357070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1019c59a-40ab-49e8-9caf-665fcc22d1ad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.357070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1019c59a-40ab-49e8-9caf-665fcc22d1ad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.357070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1019c59a-40ab-49e8-9caf-665fcc22d1ad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.357070] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1019c59a-40ab-49e8-9caf-665fcc22d1ad',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.361150] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.361269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.856906] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48008d9c-bbf6-40a2-bb47-24eddd9f74c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.863632] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1019c59a-40ab-49e8-9caf-665fcc22d1ad with status ACTIVE [ 770.863632] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.863983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.863983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.864097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.864132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.864339] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.864559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.864559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.864683] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.864756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.864999] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.865065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.865096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.865384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.865384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.865384] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1019c59a-40ab-49e8-9caf-665fcc22d1ad is going to be updated. [ 770.891975] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.891975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.891975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.891975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.891975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.891975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1019c59a-40ab-49e8-9caf-665fcc22d1ad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.088776] env[70535]: INFO networking_nsxv3.common.synchronization [req-ad8aba69-910a-4e38-ac79-1875e70196d2 req-90cb8fa1-def0-4a7f-9950-670ff85fbc51 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGHEST for action security_group_members [ 771.089036] env[70535]: INFO networking_nsxv3.common.synchronization [req-ad8aba69-910a-4e38-ac79-1875e70196d2 req-90cb8fa1-def0-4a7f-9950-670ff85fbc51 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 771.089582] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGHEST for action security_group_members [ 771.089704] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 771.090014] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe09099-3626-4cb3-9710-c5c35d48d103 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.090268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.090327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.090608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.090789] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.090995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.090995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.091116] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.091344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.091503] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.093161] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.093161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.093161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.094361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.094361] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.094361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.094361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.094361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.094566] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.094566] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.134719] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 771.135275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.135448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.135701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.135923] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.136056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.136119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.136292] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.136372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.136494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.136602] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.141204] env[70535]: INFO networking_nsxv3.common.synchronization [req-ad8aba69-910a-4e38-ac79-1875e70196d2 req-90cb8fa1-def0-4a7f-9950-670ff85fbc51 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGHEST for action security_group_rules [ 771.141407] env[70535]: INFO networking_nsxv3.common.synchronization [req-ad8aba69-910a-4e38-ac79-1875e70196d2 req-90cb8fa1-def0-4a7f-9950-670ff85fbc51 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGHEST for action security_group_members [ 771.141547] env[70535]: INFO networking_nsxv3.common.synchronization [req-ad8aba69-910a-4e38-ac79-1875e70196d2 req-90cb8fa1-def0-4a7f-9950-670ff85fbc51 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_rules [ 771.141676] env[70535]: INFO networking_nsxv3.common.synchronization [req-ad8aba69-910a-4e38-ac79-1875e70196d2 req-90cb8fa1-def0-4a7f-9950-670ff85fbc51 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 771.141806] env[70535]: INFO networking_nsxv3.common.synchronization [req-ad8aba69-910a-4e38-ac79-1875e70196d2 req-90cb8fa1-def0-4a7f-9950-670ff85fbc51 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: df7283b1-7d51-470e-b7a4-7b3425c1c0a9 with Priority: HIGHEST for action port [ 771.142319] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGHEST for action security_group_rules [ 771.142481] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_rules [ 771.142585] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df7283b1-7d51-470e-b7a4-7b3425c1c0a9 with Priority: HIGHEST for action port [ 771.142676] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGHEST for action security_group_members [ 771.142766] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 771.143226] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fe09099-3626-4cb3-9710-c5c35d48d103 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.143328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.143405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.143725] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.143725] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.144699] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.144826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.144894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.145593] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.145690] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.147724] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.147724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.147724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.147724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.147724] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df7283b1-7d51-470e-b7a4-7b3425c1c0a9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.148860] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe09099-3626-4cb3-9710-c5c35d48d103 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.148976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.149201] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.149282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.158375] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c30db4ac-0243-4260-914e-2e6a0283c93a in Status: SUCCESS [ 771.159559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.160897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.161136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.161336] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.161506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.161506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.162447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.162447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.162447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.162447] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.358360] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48008d9c-bbf6-40a2-bb47-24eddd9f74c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.598354] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.598354] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.641717] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.641717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.641717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.641717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.641717] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.641717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.641717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.641717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.641717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.641717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.641717] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.641717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.641717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.641717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.641717] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.641717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.642462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.642462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.642462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.642462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.642462] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.650554] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.650722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.651193] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe09099-3626-4cb3-9710-c5c35d48d103 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.651295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.651540] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df7283b1-7d51-470e-b7a4-7b3425c1c0a9 with status ACTIVE [ 771.651796] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.651986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.652194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.652410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.652572] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.652846] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.653251] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.653251] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.653602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.653602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.653781] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.653923] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.654793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.654793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.654793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.654793] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df7283b1-7d51-470e-b7a4-7b3425c1c0a9 is going to be updated. [ 771.665845] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.677240] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.677579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.677721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.678024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.678600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.678908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.861525] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.861856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.861991] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.862287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.862407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.862549] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 is going to be created. [ 771.893148] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.893148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.893148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.893148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.893148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.902995] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 in Status: UNINITIALIZED for 2s [ 771.942083] env[70535]: INFO networking_nsxv3.common.synchronization [req-ac2961bf-3ea8-4b86-bc1a-6e33e522ea8d req-bf88eaba-ea8e-42bf-b689-aaadedb27977 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 with Priority: HIGHEST for action security_group_members [ 771.942083] env[70535]: INFO networking_nsxv3.common.synchronization [req-ac2961bf-3ea8-4b86-bc1a-6e33e522ea8d req-bf88eaba-ea8e-42bf-b689-aaadedb27977 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGHEST for action security_group_members [ 771.942083] env[70535]: INFO networking_nsxv3.common.synchronization [req-ac2961bf-3ea8-4b86-bc1a-6e33e522ea8d req-bf88eaba-ea8e-42bf-b689-aaadedb27977 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 771.942083] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 with Priority: HIGHEST for action security_group_members [ 771.942083] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGHEST for action security_group_members [ 771.942083] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 771.944393] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.944854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.945065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.945521] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.945798] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.947238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.947238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.947238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.947238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.947238] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.948416] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe09099-3626-4cb3-9710-c5c35d48d103 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.948639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.948929] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.949131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.005989] env[70535]: INFO networking_nsxv3.common.synchronization [req-ac2961bf-3ea8-4b86-bc1a-6e33e522ea8d req-bf88eaba-ea8e-42bf-b689-aaadedb27977 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGHEST for action security_group_rules [ 772.006272] env[70535]: INFO networking_nsxv3.common.synchronization [req-ac2961bf-3ea8-4b86-bc1a-6e33e522ea8d req-bf88eaba-ea8e-42bf-b689-aaadedb27977 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGHEST for action security_group_members [ 772.006463] env[70535]: INFO networking_nsxv3.common.synchronization [req-ac2961bf-3ea8-4b86-bc1a-6e33e522ea8d req-bf88eaba-ea8e-42bf-b689-aaadedb27977 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 with Priority: HIGHEST for action security_group_rules [ 772.006667] env[70535]: INFO networking_nsxv3.common.synchronization [req-ac2961bf-3ea8-4b86-bc1a-6e33e522ea8d req-bf88eaba-ea8e-42bf-b689-aaadedb27977 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 with Priority: HIGHEST for action security_group_members [ 772.006839] env[70535]: INFO networking_nsxv3.common.synchronization [req-ac2961bf-3ea8-4b86-bc1a-6e33e522ea8d req-bf88eaba-ea8e-42bf-b689-aaadedb27977 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_rules [ 772.007073] env[70535]: INFO networking_nsxv3.common.synchronization [req-ac2961bf-3ea8-4b86-bc1a-6e33e522ea8d req-bf88eaba-ea8e-42bf-b689-aaadedb27977 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 772.007266] env[70535]: INFO networking_nsxv3.common.synchronization [req-ac2961bf-3ea8-4b86-bc1a-6e33e522ea8d req-bf88eaba-ea8e-42bf-b689-aaadedb27977 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: df7283b1-7d51-470e-b7a4-7b3425c1c0a9 with Priority: HIGHEST for action port [ 772.007908] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGHEST for action security_group_rules [ 772.008121] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 with Priority: HIGHEST for action security_group_rules [ 772.008234] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 772.008488] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df7283b1-7d51-470e-b7a4-7b3425c1c0a9 with Priority: HIGHEST for action port [ 772.008531] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_rules [ 772.008621] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGHEST for action security_group_members [ 772.008758] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 with Priority: HIGHEST for action security_group_members [ 772.011479] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fe09099-3626-4cb3-9710-c5c35d48d103 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.011479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.011479] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.011479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.011479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.011479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.011479] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.012228] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.012228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.012312] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.012419] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.012575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.012770] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.012861] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df7283b1-7d51-470e-b7a4-7b3425c1c0a9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.014095] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.014244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.014480] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe09099-3626-4cb3-9710-c5c35d48d103 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.014638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.014811] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.016902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.100302] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.101611] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.144706] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for acf72aac-3e82-4909-b3c4-dccd81be0846: rpc.has_security_group_logging(os_id): False [ 772.163406] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.163573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.163649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.163889] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.164015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.164526] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.164526] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.164526] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.164689] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.164689] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.164898] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.165076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.165138] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.165263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.165343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.165558] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.165670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.165733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.165894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.165973] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.166098] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 772.168566] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c30db4ac-0243-4260-914e-2e6a0283c93a: rpc.has_security_group_logging(os_id): False [ 772.202945] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.204295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.204295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.204803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.206031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.206031] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.206031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.206031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.206681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.206896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.207103] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c30db4ac-0243-4260-914e-2e6a0283c93a is going to be created. [ 772.295111] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.295111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.295111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.295111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.295111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.310891] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 772.332681] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.332827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.332915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.333161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.333353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.358594] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c30db4ac-0243-4260-914e-2e6a0283c93a in Status: IN_PROGRESS for 2s [ 772.451079] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.516737] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df7283b1-7d51-470e-b7a4-7b3425c1c0a9 with status ACTIVE [ 772.516737] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.516968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.518514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.518832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.518942] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.519197] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.519322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.519391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.519557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.519640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.519833] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.519930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.519993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.520149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.520227] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.520322] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df7283b1-7d51-470e-b7a4-7b3425c1c0a9 is going to be updated. [ 772.521538] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.521675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.560025] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.560218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.560290] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.560489] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.561233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.561233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df7283b1-7d51-470e-b7a4-7b3425c1c0a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.604318] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.604534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.604721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.604890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.604990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.605109] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 772.606562] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.606702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.606802] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.609050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.609050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.609050] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 is going to be created. [ 772.664746] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.665014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.665147] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.665470] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.665756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.681077] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.681321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.681439] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.681742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.681958] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.688263] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: UNINITIALIZED for 2s [ 772.698144] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 772.957548] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.452160] env[70535]: INFO networking_nsxv3.common.synchronization [req-1eb7edea-a6dd-4092-8fe2-8b37f35cb9d1 req-f2bfec75-7131-4553-92f5-9308ce7cc629 tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_members [ 773.452160] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_members [ 773.452160] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.452160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.452160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.453420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.453651] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.453789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.453878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.454090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.454227] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.454395] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.459283] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.459363] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.459425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.459607] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.459698] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.459790] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 is going to be created. [ 773.486820] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.487071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.487141] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.487414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.487615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.499244] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 in Status: UNINITIALIZED for 2s [ 773.913462] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 in Status: SUCCESS [ 773.913462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.913462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.914424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.914424] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.914424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.914424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.914424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.914424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.914424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.914696] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48008d9c-bbf6-40a2-bb47-24eddd9f74c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.960039] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.960039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.960039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.960039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.960039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.960039] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.960039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.960039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.960039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.960039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.960039] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 already deleted. [ 773.960039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.009802] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.009802] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.009802] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.010012] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.010901] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.010901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.010901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.010901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.010901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.011297] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.011503] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.011658] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.011947] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.011947] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.012116] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.012300] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.032656] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.032656] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 774.032656] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.032656] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.032899] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-c5cd361b-1720-4679-bce3-729e36a0bc06 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.032899] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-c5cd361b-1720-4679-bce3-729e36a0bc06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.032997] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-c5cd361b-1720-4679-bce3-729e36a0bc06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.033363] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-c5cd361b-1720-4679-bce3-729e36a0bc06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.033566] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5cd361b-1720-4679-bce3-729e36a0bc06',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.324463] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 774.324597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.373891] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c30db4ac-0243-4260-914e-2e6a0283c93a in Status: SUCCESS [ 774.374169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.416776] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48008d9c-bbf6-40a2-bb47-24eddd9f74c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.537166] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.537166] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.537166] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.537783] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.537783] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.537783] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port c5cd361b-1720-4679-bce3-729e36a0bc06 not found, creating... [ 774.537961] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.538128] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.538251] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.538479] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.538618] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.538926] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.539115] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.539240] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.539455] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.539585] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.539725] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: c5cd361b-1720-4679-bce3-729e36a0bc06 is going to be created. [ 774.563902] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.564107] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.564236] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.564601] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.564862] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.565132] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-c5cd361b-1720-4679-bce3-729e36a0bc06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.711544] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 774.712305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.713664] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: SUCCESS [ 774.713664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.713664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.713664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.713891] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.713891] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.713983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.714096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.714179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.714275] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.715176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.715317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.715576] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.715655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.715709] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.715857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.715962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.716069] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.920174] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48008d9c-bbf6-40a2-bb47-24eddd9f74c2: rpc.has_security_group_logging(os_id): False [ 774.944149] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.944327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.944885] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.944998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.945057] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.945361] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.945786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.945872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.946067] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.946154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.946352] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 is going to be created. [ 775.016314] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.016474] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.016750] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.017108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.017321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.031937] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 in Status: IN_PROGRESS for 2s [ 775.217722] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.221761] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.510131] env[70535]: INFO networking_nsxv3.common.synchronization [req-1eb7edea-a6dd-4092-8fe2-8b37f35cb9d1 req-528a76a9-c4d9-4bef-9c63-63fe6d7b77b6 service nova] Enqueued Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_rules [ 775.510379] env[70535]: INFO networking_nsxv3.common.synchronization [req-1eb7edea-a6dd-4092-8fe2-8b37f35cb9d1 req-528a76a9-c4d9-4bef-9c63-63fe6d7b77b6 service nova] Enqueued Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_members [ 775.510610] env[70535]: INFO networking_nsxv3.common.synchronization [req-1eb7edea-a6dd-4092-8fe2-8b37f35cb9d1 req-528a76a9-c4d9-4bef-9c63-63fe6d7b77b6 service nova] Enqueued Resource ID: c5cd361b-1720-4679-bce3-729e36a0bc06 with Priority: HIGHEST for action port [ 775.511868] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 in Status: SUCCESS [ 775.512193] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.512731] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_rules [ 775.514341] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_members [ 775.514524] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cd361b-1720-4679-bce3-729e36a0bc06 with Priority: HIGHEST for action port [ 775.515123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.515408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.515657] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.515832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.515890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.516102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.516206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.516334] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.517466] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.517636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.517743] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.518105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.518240] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.519406] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.519657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.519657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.519885] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.519978] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.520102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.520163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.520307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.520400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.520494] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.521695] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5cd361b-1720-4679-bce3-729e36a0bc06 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.521794] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5cd361b-1720-4679-bce3-729e36a0bc06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.524759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5cd361b-1720-4679-bce3-729e36a0bc06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.524759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5cd361b-1720-4679-bce3-729e36a0bc06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.524759] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5cd361b-1720-4679-bce3-729e36a0bc06',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.719728] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.727927] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.024926] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.025066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.025205] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.026272] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.031913] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5cd361b-1720-4679-bce3-729e36a0bc06 with status ACTIVE [ 776.032070] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.032508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.032508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.032508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.032655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.033071] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.033071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.033071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.033071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.033256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.033315] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.033486] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.033558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.033706] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.033796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.033886] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5cd361b-1720-4679-bce3-729e36a0bc06 is going to be updated. [ 776.061654] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.061836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.061868] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.062085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.062477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.062477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5cd361b-1720-4679-bce3-729e36a0bc06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.222065] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.222235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.222291] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.222507] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.222599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.222692] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 776.230045] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.230045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.230045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.230372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.230372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.230372] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 is going to be updated. [ 776.261456] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.261617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.261689] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.261898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.262062] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.267545] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.267690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.268058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.268058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.268058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.278970] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 776.279585] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: IN_PROGRESS for 2s [ 776.528158] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.529251] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.031127] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.031646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.031646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.031791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.031916] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.032075] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 is going to be created. [ 777.035297] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.035532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.035532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.035759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.036355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.036355] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 is going to be updated. [ 777.056867] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 in Status: SUCCESS [ 777.057174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.063712] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.063931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.063993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.064257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.064494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.075267] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.075494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.075697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.075919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.076175] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.077832] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 in Status: UNINITIALIZED for 2s [ 777.087085] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 in Status: IN_PROGRESS for 2s [ 778.292054] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: SUCCESS [ 778.292376] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.293042] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 778.293241] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.293451] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.293700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.293907] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.294103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.294185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.294455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.294557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.294664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.294817] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.296091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.296386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.296696] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.296900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.297080] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.297351] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.297502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.297641] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.297776] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.299117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.299363] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.299647] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.299799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.299903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.300148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.300272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.300408] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.301362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.302391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.302391] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.302391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.302391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.302391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.302612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.302671] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.799595] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.804567] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.805568] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.805677] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.806057] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.094292] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 in Status: SUCCESS [ 779.094771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.094851] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.095259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.095475] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.095727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.095727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.095934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.096081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.096270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.096407] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.098629] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 in Status: SUCCESS [ 779.098820] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.099044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.099272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.099512] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.099673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.099795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.099979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.100132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.101040] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.101040] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.305847] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0fe09099-3626-4cb3-9710-c5c35d48d103: rpc.has_security_group_logging(os_id): False [ 779.307555] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.311800] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.327529] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.327682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.327753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.327974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.328383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.329112] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.329112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.329112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.329271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.329271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.329349] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 is going to be created. [ 779.393560] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.393888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.394318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.395112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.395112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.416808] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: IN_PROGRESS for 2s [ 779.606414] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.606414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.606414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.606414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.606414] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.606414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.606414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.606414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.606414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.606414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.606414] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.606414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.606414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.606414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.609462] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.609462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.609462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.609462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.609462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.609462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.609462] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.611269] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.809559] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.809914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.809914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.810180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.810282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.810389] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 is going to be updated. [ 779.814747] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.815303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.815303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.815303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.815465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.815538] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 779.835023] env[70535]: INFO networking_nsxv3.common.synchronization [None req-c5f6222d-0077-4431-ab62-83956a02808f None None] Enqueued Resource ID: 0751d713-16f1-4357-8f69-9153f9ef86de with Priority: HIGHEST for action port [ 779.835752] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0751d713-16f1-4357-8f69-9153f9ef86de with Priority: HIGHEST for action port [ 779.836147] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-0751d713-16f1-4357-8f69-9153f9ef86de taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.838343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0751d713-16f1-4357-8f69-9153f9ef86de" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.838343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0751d713-16f1-4357-8f69-9153f9ef86de" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.838343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0751d713-16f1-4357-8f69-9153f9ef86de" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.838343] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0751d713-16f1-4357-8f69-9153f9ef86de',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.846649] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.846893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.846954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.847249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.847414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.849752] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.849883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.850452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.850452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.850452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.864449] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 779.866059] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: IN_PROGRESS for 2s [ 780.116312] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8d7fb02-d4e1-40c2-a711-afb7188e3a15: rpc.has_security_group_logging(os_id): False [ 780.116312] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3: rpc.has_security_group_logging(os_id): False [ 780.142577] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.142577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.142577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.142943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.143049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.143262] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.143389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.143504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.143682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.143762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.144184] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.144310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.144372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.144969] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.144969] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.144969] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.144969] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.144969] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.145209] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.148028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.148028] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 is going to be created. [ 780.148854] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.148974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.149057] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.149233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.149317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.149523] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.149629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.149690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.149837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.149913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.150024] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 is going to be created. [ 780.275860] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.275860] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.275860] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.275860] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.275860] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.299795] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 in Status: IN_PROGRESS for 2s [ 780.300838] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.300996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.301071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.301538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.301538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.323649] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 in Status: IN_PROGRESS for 2s [ 780.340044] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0751d713-16f1-4357-8f69-9153f9ef86de [ 780.340275] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.340416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.340478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.340874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.340972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.341097] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0751d713-16f1-4357-8f69-9153f9ef86de already deleted. [ 780.341179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0751d713-16f1-4357-8f69-9153f9ef86de" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.437330] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: SUCCESS [ 781.437842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.437842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.437988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.438062] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.796143] env[70535]: INFO networking_nsxv3.common.synchronization [None req-ea0af4c4-8068-40d3-9a68-c98edee13ff8 None None] Enqueued Resource ID: 5f024982-0b5c-40b7-b060-dc3356a03916 with Priority: HIGHEST for action port [ 781.796143] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f024982-0b5c-40b7-b060-dc3356a03916 with Priority: HIGHEST for action port [ 781.796143] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f024982-0b5c-40b7-b060-dc3356a03916 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.796143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f024982-0b5c-40b7-b060-dc3356a03916" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.796143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f024982-0b5c-40b7-b060-dc3356a03916" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.796671] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f024982-0b5c-40b7-b060-dc3356a03916" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.797106] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f024982-0b5c-40b7-b060-dc3356a03916',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.880024] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: SUCCESS [ 781.880024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.880024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.880024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.880024] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.880024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.880024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.880024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.880024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.880024] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.880700] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 781.880961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.881209] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.881485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.881830] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.882376] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.882525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.882744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.883599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.883792] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.940392] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe09099-3626-4cb3-9710-c5c35d48d103 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.940525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.147153] env[70535]: INFO networking_nsxv3.common.synchronization [req-131c29a3-c066-4abc-ace5-110d35e7f92d req-165f635d-50c9-4ac7-85bf-bdecb264200e tempest-ListServersNegativeTestJSON-1092584325 tempest-ListServersNegativeTestJSON-1092584325-project-member] Enqueued Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 782.147695] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 782.148052] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.148138] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.148205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.148412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.148611] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.148745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.148812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.148975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.149208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.149357] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.267220] env[70535]: INFO networking_nsxv3.common.synchronization [req-be932b1f-2c43-49ae-a2e4-82e5a50712b9 req-16ae9b4f-f072-49fd-b6e8-6ae724491f01 tempest-ListImageFiltersTestJSON-1844606616 tempest-ListImageFiltersTestJSON-1844606616-project-member] Enqueued Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_members [ 782.267962] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_members [ 782.268919] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.269070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.269184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.270157] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.270380] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.270531] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.270644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.270835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.270919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.271036] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.282064] env[70535]: INFO networking_nsxv3.common.synchronization [req-c141ee8b-7f54-4842-a94f-bde8ec99c47e req-e11215f2-1262-4bbd-bc44-9acffc44e241 tempest-ListServersNegativeTestJSON-1092584325 tempest-ListServersNegativeTestJSON-1092584325-project-member] Enqueued Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 782.282669] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGHEST for action security_group_members [ 782.282988] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.283704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.299446] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f024982-0b5c-40b7-b060-dc3356a03916 [ 782.299632] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.299752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.299821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.300053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.300150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.300246] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f024982-0b5c-40b7-b060-dc3356a03916 already deleted. [ 782.300328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f024982-0b5c-40b7-b060-dc3356a03916" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.317156] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 in Status: SUCCESS [ 782.317955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.338259] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 in Status: SUCCESS [ 782.338575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.385589] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.388061] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.652708] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.773192] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.888284] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.889312] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.155046] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.277757] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.391289] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.391507] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.391598] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.391888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.392112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.392112] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 is going to be updated. [ 783.395287] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.395443] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.395521] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.395757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.395858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.396032] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 783.425995] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.426168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.426240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.426454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.426602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.431938] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.432089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.432155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.432348] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.432483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.436057] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 783.439275] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: IN_PROGRESS for 2s [ 783.661337] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.661637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.661637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.661793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.661885] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.662462] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00628945-9b3d-4cd6-939f-483e37c62dbe is going to be updated. [ 783.691894] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.692089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.692134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.692568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.692723] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.702969] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: IN_PROGRESS for 2s [ 783.781801] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.782109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.782206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.782448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.782562] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.782670] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 is going to be updated. [ 783.811524] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.811660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.811738] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.811946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.812097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.821820] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: IN_PROGRESS for 2s [ 785.448517] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 785.448860] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.449110] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.449412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.449671] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.449849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.450016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.450162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.450279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.450395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.450612] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.450747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.450830] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.451053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.451270] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.451418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.451533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.451996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.452128] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.452253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.452367] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.454534] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: SUCCESS [ 785.454769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.454994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.455244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.455485] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.455624] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.455712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.455903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.456133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.456236] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.456276] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.715945] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: SUCCESS [ 785.715945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.716211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.716334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.716628] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.716814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.716930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.717208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.717357] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.717566] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.832111] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: SUCCESS [ 785.832111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.958747] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2: rpc.has_security_group_logging(os_id): False [ 785.960291] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.987293] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.987532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.987653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.987953] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.988121] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.988545] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.988713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.988758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.989023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.989146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.989389] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.989559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.989603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.989793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.989912] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.990190] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.990331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.990427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.990612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.990722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.990839] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 786.075800] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.075939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.075939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.076217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.076356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.095720] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 786.220274] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.220456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.220617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.220745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.220846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.221080] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.221188] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.221252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.221409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.221496] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.221601] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00628945-9b3d-4cd6-939f-483e37c62dbe is going to be updated. [ 786.249021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.249170] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.249332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.249507] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.249653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.261160] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: IN_PROGRESS for 2s [ 786.463416] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0fe09099-3626-4cb3-9710-c5c35d48d103: rpc.has_security_group_logging(os_id): False [ 786.482556] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.482907] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.483033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.483339] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.483525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.483886] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.484079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.484331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.484434] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.484554] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.484684] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 is going to be updated. [ 786.547443] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.547655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.547655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.548027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.548119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.576991] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: IN_PROGRESS for 2s [ 787.283199] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 787.283379] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 787.761045] env[70535]: INFO networking_nsxv3.common.synchronization [req-77ebe2a6-d517-4033-b640-24a235d4a4b9 req-a8abd7fb-29e2-4196-b687-7c275e43d608 tempest-ImagesTestJSON-1564979202 tempest-ImagesTestJSON-1564979202-project-member] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 787.761045] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 787.761045] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.761045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.761045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.761045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.761045] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.761045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.761045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.761045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.761045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.761045] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.115148] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 788.115418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.115739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.115873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.115974] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.179921] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.180138] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.180262] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.180532] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.180787] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.180940] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.181979] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.181979] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.182259] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.182571] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 788.182780] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.182985] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.183214] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.183440] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 788.183782] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.184057] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.219755] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.219755] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 788.219755] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.219755] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.220047] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-e1683811-e822-483e-81e0-2633ff195493 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.221030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-e1683811-e822-483e-81e0-2633ff195493" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.221030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-e1683811-e822-483e-81e0-2633ff195493" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.221030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-e1683811-e822-483e-81e0-2633ff195493" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.221030] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1683811-e822-483e-81e0-2633ff195493',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.266264] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.266264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.266264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.266264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.266264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.266264] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.266264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.266585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.266585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.266585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.266678] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 788.274186] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00628945-9b3d-4cd6-939f-483e37c62dbe in Status: SUCCESS [ 788.274186] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00628945-9b3d-4cd6-939f-483e37c62dbe deletion is rescheduled due to dependency. [ 788.275347] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.295187] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.295187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.295187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.295345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.295480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.309386] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 788.592154] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: SUCCESS [ 788.592154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.618669] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.618842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.618915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.619169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.619372] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.619493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.619658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.619710] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.619803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.620162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.620162] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.725503] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.725730] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.725904] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.726244] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.726380] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.726517] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port e1683811-e822-483e-81e0-2633ff195493 not found, creating... [ 788.726773] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.726951] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.727104] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.727288] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.727428] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.727709] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.727865] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.727981] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.728286] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.728387] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.728529] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: e1683811-e822-483e-81e0-2633ff195493 is going to be created. [ 788.755053] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.755053] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.755053] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.755325] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.755523] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.755745] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-e1683811-e822-483e-81e0-2633ff195493" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.122549] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.122926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.122926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.123093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.123375] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.123513] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.123650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.123852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.123973] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.124159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.124329] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.124483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.124575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.124749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.124900] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.124997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.125069] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.125252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.125370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.125485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.125604] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.498097] env[70535]: INFO networking_nsxv3.common.synchronization [req-77ebe2a6-d517-4033-b640-24a235d4a4b9 req-144a2b3e-6e9b-4d29-b60e-14b6b81bd824 service nova] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_rules [ 789.498306] env[70535]: INFO networking_nsxv3.common.synchronization [req-77ebe2a6-d517-4033-b640-24a235d4a4b9 req-144a2b3e-6e9b-4d29-b60e-14b6b81bd824 service nova] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 789.498450] env[70535]: INFO networking_nsxv3.common.synchronization [req-77ebe2a6-d517-4033-b640-24a235d4a4b9 req-144a2b3e-6e9b-4d29-b60e-14b6b81bd824 service nova] Enqueued Resource ID: e1683811-e822-483e-81e0-2633ff195493 with Priority: HIGHEST for action port [ 789.498689] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_rules [ 789.498820] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 789.498917] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1683811-e822-483e-81e0-2633ff195493 with Priority: HIGHEST for action port [ 789.500961] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.500961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.500961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.500961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.500961] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.500961] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.500961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.501220] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1683811-e822-483e-81e0-2633ff195493 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.501267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1683811-e822-483e-81e0-2633ff195493" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.501325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1683811-e822-483e-81e0-2633ff195493" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.501472] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1683811-e822-483e-81e0-2633ff195493" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.501569] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1683811-e822-483e-81e0-2633ff195493',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.628864] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2: rpc.has_security_group_logging(os_id): False [ 789.648309] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.648585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.648672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.648874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.648968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.649263] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.649632] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.649632] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.649632] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.649800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.649853] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.649940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.650048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.650148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.650231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.650422] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.650517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.650568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.650716] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.650773] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.650858] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 789.725242] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.725412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.725485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.725694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.725842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.745549] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 789.751607] env[70535]: INFO networking_nsxv3.common.synchronization [req-d30a53e1-e051-4208-b506-2d311503b194 req-866791ee-0a4c-4734-bece-a1d856f4d7aa tempest-ServerDiskConfigTestJSON-1021082095 tempest-ServerDiskConfigTestJSON-1021082095-project-member] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 789.751607] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 789.751607] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.751607] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.751607] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.751896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.751896] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.751964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.751998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.752518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.752518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.752598] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.974097] env[70535]: INFO networking_nsxv3.common.synchronization [req-950455e3-7184-431f-a6ef-41849b033ef1 req-0981328f-de08-4d9d-b2c6-4a21a09ecc66 tempest-ServerActionsTestOtherB-1362861695 tempest-ServerActionsTestOtherB-1362861695-project-member] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 789.974609] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 789.974926] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.975089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.975156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.975407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.975562] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.975741] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.975811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.975974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.976073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.976162] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.003105] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.003330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.003398] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1683811-e822-483e-81e0-2633ff195493 with status ACTIVE [ 790.003609] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.003743] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.003832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.004046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.004168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.004395] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.006446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.006446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.006446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.006446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.006446] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.006446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.006446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.006446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.006446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.006446] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1683811-e822-483e-81e0-2633ff195493 is going to be updated. [ 790.029650] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.029851] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.029948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.030232] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.030411] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.030637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1683811-e822-483e-81e0-2633ff195493" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.255417] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.255754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.255754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.255984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.255984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.257166] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.257166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.257166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.257166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.257166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.257166] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 790.302318] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.303100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.303291] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.303655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.303905] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.317092] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 790.322458] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 790.322458] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e deletion is rescheduled due to dependency. [ 790.322458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.322458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.322458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.322458] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.322458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.322458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.322458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.322458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.322458] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.358733] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.358733] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.358733] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.359044] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.359318] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.359547] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.360471] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.361155] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.361746] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.361899] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.362080] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.362327] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.362969] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.364081] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.364259] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.364743] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.391751] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.392124] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 790.392624] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.392699] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.393132] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-7803275c-6f25-4e51-9478-5f513eb5f0a8 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.393371] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-7803275c-6f25-4e51-9478-5f513eb5f0a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.393547] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-7803275c-6f25-4e51-9478-5f513eb5f0a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.393982] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-7803275c-6f25-4e51-9478-5f513eb5f0a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.394296] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7803275c-6f25-4e51-9478-5f513eb5f0a8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.477875] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.478182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.478273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.478485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.478601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.478836] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.478959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.479110] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.479253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.479571] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.479571] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c already deleted. [ 790.479571] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.548086] env[70535]: INFO networking_nsxv3.common.synchronization [req-3dae7227-61a7-4b18-b411-04ed00c4c29e req-1b337f0e-c6a2-4e76-a0e6-cb470fc2e238 tempest-FloatingIPsAssociationTestJSON-570582915 tempest-FloatingIPsAssociationTestJSON-570582915-project-member] Enqueued Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_members [ 790.549052] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGHEST for action security_group_members [ 790.549052] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.549227] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.549227] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.549375] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.549820] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.549820] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.549820] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.549820] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.549989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.549989] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.824479] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.898271] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.898526] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.898621] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.898908] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.899083] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.899251] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 7803275c-6f25-4e51-9478-5f513eb5f0a8 not found, creating... [ 790.899517] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.899676] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.899797] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.900030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.900174] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.900467] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.900626] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.900744] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.900952] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.901675] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.901862] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 7803275c-6f25-4e51-9478-5f513eb5f0a8 is going to be created. [ 790.931013] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.931299] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.931430] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.931828] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.932073] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.932313] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-7803275c-6f25-4e51-9478-5f513eb5f0a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.054911] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.055118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.055182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.055459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.055459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.055675] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.055778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.055844] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.056017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.056100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.056189] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b34086e-8eac-4499-9c02-2280b24b0698 is going to be updated. [ 791.110527] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.110527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.110527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.110842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.110842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.121307] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: IN_PROGRESS for 2s [ 791.326350] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.758282] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 791.758282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.829112] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.829317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.829402] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.829666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.829788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.829914] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 791.865980] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.866448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.866448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.866448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.866635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.876070] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 792.015528] env[70535]: INFO networking_nsxv3.common.synchronization [req-950455e3-7184-431f-a6ef-41849b033ef1 req-25e7efc2-06aa-4d1d-bc54-aae59a8a6676 service nova] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_rules [ 792.015715] env[70535]: INFO networking_nsxv3.common.synchronization [req-950455e3-7184-431f-a6ef-41849b033ef1 req-25e7efc2-06aa-4d1d-bc54-aae59a8a6676 service nova] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 792.015855] env[70535]: INFO networking_nsxv3.common.synchronization [req-950455e3-7184-431f-a6ef-41849b033ef1 req-25e7efc2-06aa-4d1d-bc54-aae59a8a6676 service nova] Enqueued Resource ID: 7803275c-6f25-4e51-9478-5f513eb5f0a8 with Priority: HIGHEST for action port [ 792.016111] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_rules [ 792.016241] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 792.016336] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803275c-6f25-4e51-9478-5f513eb5f0a8 with Priority: HIGHEST for action port [ 792.018086] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.018206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.018278] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.018489] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.018572] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.022964] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.022964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.022964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.022964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.022964] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.022964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.022964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.022964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.022964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.022964] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.022964] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-7803275c-6f25-4e51-9478-5f513eb5f0a8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.022964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7803275c-6f25-4e51-9478-5f513eb5f0a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.022964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7803275c-6f25-4e51-9478-5f513eb5f0a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.022964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7803275c-6f25-4e51-9478-5f513eb5f0a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.022964] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7803275c-6f25-4e51-9478-5f513eb5f0a8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.328908] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 792.328908] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 deletion is rescheduled due to dependency. [ 792.328908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.523691] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.524451] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.524577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.525024] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7803275c-6f25-4e51-9478-5f513eb5f0a8 with status ACTIVE [ 792.525024] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.525024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.525195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.525379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.525379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.527066] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.527066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.527066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.527066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.527066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.527452] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.527569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.527629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.527779] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.527878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.527959] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7803275c-6f25-4e51-9478-5f513eb5f0a8 is going to be updated. [ 792.549897] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.549897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.549897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.549897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.549897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.549897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7803275c-6f25-4e51-9478-5f513eb5f0a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.030217] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.132715] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: IN_PROGRESS for 4s [ 793.532602] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.532918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.532918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.533299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.533299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.533405] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be created. [ 793.558506] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.558660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.558743] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.558943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.559198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.571946] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: UNINITIALIZED for 2s [ 793.888705] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 793.888919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.889142] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.889437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.889699] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.889828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.889894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.890097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.890187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.890277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.890369] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.935437] env[70535]: INFO networking_nsxv3.common.synchronization [req-57a8284c-78be-4f7b-a605-017b57537461 req-b43a21b3-c731-4c84-b229-a739a9444cdf tempest-ServersTestFqdnHostnames-408043169 tempest-ServersTestFqdnHostnames-408043169-project-member] Enqueued Resource ID: 89135034-9b45-4344-b065-0229db08f4f9 with Priority: HIGHEST for action security_group_members [ 793.936146] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89135034-9b45-4344-b065-0229db08f4f9 with Priority: HIGHEST for action security_group_members [ 793.936498] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-89135034-9b45-4344-b065-0229db08f4f9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.936636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.936717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.937052] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.937297] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.937453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.937522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.937708] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.937798] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.937895] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89135034-9b45-4344-b065-0229db08f4f9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.355857] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.356102] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-328" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.356226] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-328" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.356652] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-328" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.356983] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.359580] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.359792] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.360098] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.360266] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.361160] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.361289] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.361405] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.361522] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.361657] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.361777] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.361913] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.386353] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.386518] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 794.386664] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.386872] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-328" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.387223] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-d39bb0b4-ef56-4db4-ae07-0e2539b8ce93 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.387442] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-d39bb0b4-ef56-4db4-ae07-0e2539b8ce93" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.387579] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-d39bb0b4-ef56-4db4-ae07-0e2539b8ce93" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.388042] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-d39bb0b4-ef56-4db4-ae07-0e2539b8ce93" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.388186] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d39bb0b4-ef56-4db4-ae07-0e2539b8ce93',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.394783] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.394942] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.395000] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.395233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.395788] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.395788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.395788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.395788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.395788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.396050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.396050] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.397145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.397145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.397145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.397145] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.397145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.397145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.397145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.397145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.397145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.397145] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.441231] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.441460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.441565] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.441824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.441963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.442273] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.442431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.442542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.443017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.443173] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.443316] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89135034-9b45-4344-b065-0229db08f4f9 already deleted. [ 794.443452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.895887] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.896433] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.896433] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.897164] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.897164] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.897164] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port d39bb0b4-ef56-4db4-ae07-0e2539b8ce93 not found, creating... [ 794.897164] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.897492] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.897689] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.898024] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.898239] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.898599] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.898812] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.898993] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.899354] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.899558] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.899792] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: d39bb0b4-ef56-4db4-ae07-0e2539b8ce93 is going to be created. [ 794.901030] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52023f52-3978-48e2-8510-00221c047d2e: rpc.has_security_group_logging(os_id): False [ 794.921441] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.921839] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.921839] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.922331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.922331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.922331] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.922331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.922553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.922553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.922621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.922782] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.922925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.922925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.923123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.923179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.923343] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.923433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.923494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.923660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.924292] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.924292] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 794.928039] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.928039] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.928039] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.928292] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.928396] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.928640] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-d39bb0b4-ef56-4db4-ae07-0e2539b8ce93" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.007529] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.007752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.007752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.008074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.008231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.028972] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 795.148617] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b34086e-8eac-4499-9c02-2280b24b0698 in Status: SUCCESS [ 795.148925] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b34086e-8eac-4499-9c02-2280b24b0698 deletion is rescheduled due to dependency. [ 795.149855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.584034] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 795.584034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.584034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.584034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.584034] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.584034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.584034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.585225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.586343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.586597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.587212] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.749688] env[70535]: INFO networking_nsxv3.common.synchronization [req-57a8284c-78be-4f7b-a605-017b57537461 req-12f90eb9-ed08-4b24-9dd9-2ba659c671cf service nova] Enqueued Resource ID: 89135034-9b45-4344-b065-0229db08f4f9 with Priority: HIGHEST for action security_group_rules [ 795.749688] env[70535]: INFO networking_nsxv3.common.synchronization [req-57a8284c-78be-4f7b-a605-017b57537461 req-12f90eb9-ed08-4b24-9dd9-2ba659c671cf service nova] Enqueued Resource ID: 89135034-9b45-4344-b065-0229db08f4f9 with Priority: HIGHEST for action security_group_members [ 795.749893] env[70535]: INFO networking_nsxv3.common.synchronization [req-57a8284c-78be-4f7b-a605-017b57537461 req-12f90eb9-ed08-4b24-9dd9-2ba659c671cf service nova] Enqueued Resource ID: d39bb0b4-ef56-4db4-ae07-0e2539b8ce93 with Priority: HIGHEST for action port [ 795.749955] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89135034-9b45-4344-b065-0229db08f4f9 with Priority: HIGHEST for action security_group_rules [ 795.750623] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89135034-9b45-4344-b065-0229db08f4f9 with Priority: HIGHEST for action security_group_members [ 795.750764] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d39bb0b4-ef56-4db4-ae07-0e2539b8ce93 with Priority: HIGHEST for action port [ 795.751319] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89135034-9b45-4344-b065-0229db08f4f9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.751445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.751543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.751709] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.751811] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89135034-9b45-4344-b065-0229db08f4f9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.753230] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-89135034-9b45-4344-b065-0229db08f4f9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.753230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.753230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.753230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.753524] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.753712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.753787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.753941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.754037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.754128] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89135034-9b45-4344-b065-0229db08f4f9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.761293] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-d39bb0b4-ef56-4db4-ae07-0e2539b8ce93 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.761293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d39bb0b4-ef56-4db4-ae07-0e2539b8ce93" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.761293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d39bb0b4-ef56-4db4-ae07-0e2539b8ce93" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.761293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d39bb0b4-ef56-4db4-ae07-0e2539b8ce93" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.761514] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d39bb0b4-ef56-4db4-ae07-0e2539b8ce93',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.089351] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.261742] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89135034-9b45-4344-b065-0229db08f4f9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.262965] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-89135034-9b45-4344-b065-0229db08f4f9 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.263062] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.263296] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d39bb0b4-ef56-4db4-ae07-0e2539b8ce93 with status ACTIVE [ 796.263494] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.263682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.263772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.264016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.264122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.264288] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.264404] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.264433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.264591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.264700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.264853] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.264988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.264988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.265165] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.265239] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.265359] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d39bb0b4-ef56-4db4-ae07-0e2539b8ce93 is going to be updated. [ 796.290662] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.290662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.290662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.290662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.290662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.290662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d39bb0b4-ef56-4db4-ae07-0e2539b8ce93" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.596030] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f0ce39e-83c0-4345-91bb-9366dd77a60c: rpc.has_security_group_logging(os_id): False [ 796.613270] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.613424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.613492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.613865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.613958] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.614257] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.614361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.614424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.614582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.614655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.614742] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be created. [ 796.684270] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.684503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.684503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.684686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.684862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.698200] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: IN_PROGRESS for 2s [ 796.756033] env[70535]: INFO networking_nsxv3.common.synchronization [req-16e6b19e-0d81-4ed8-8e9b-00b39601bd83 req-94ecd0c1-d999-4af5-99d7-733a02dc0b9f tempest-ServersTestJSON-1256413413 tempest-ServersTestJSON-1256413413-project-member] Enqueued Resource ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 with Priority: HIGHEST for action security_group_members [ 796.756455] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 with Priority: HIGHEST for action security_group_members [ 796.756769] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.756894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.756956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.757306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.757621] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.757621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.757621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.757792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.757864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.757962] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46eec3ed-88a9-4ea1-a649-2f92efa91eb5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.767819] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89135034-9b45-4344-b065-0229db08f4f9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.047511] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 797.047748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.263185] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.263185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.263185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.263185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.263185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.263185] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.263185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.263185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.263185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.263185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.263185] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 already deleted. [ 797.263185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.269643] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.269774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.269873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.270227] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.270322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.270424] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89135034-9b45-4344-b065-0229db08f4f9 is going to be created. [ 797.297954] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.298182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.298255] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.298538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.302188] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.310391] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89135034-9b45-4344-b065-0229db08f4f9 in Status: UNINITIALIZED for 2s [ 797.355248] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.355469] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-433" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.355601] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-433" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.355978] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-433" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.358624] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.358866] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.358971] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.359257] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.359625] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.359872] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.363024] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.363024] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.363024] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.363024] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.363024] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.363024] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.383243] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.383243] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 797.383243] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.383243] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-433" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.383391] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-c005ff21-4a9c-4a34-8ed5-1ed1c582afea taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.383475] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-c005ff21-4a9c-4a34-8ed5-1ed1c582afea" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.383601] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-c005ff21-4a9c-4a34-8ed5-1ed1c582afea" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.384255] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-c005ff21-4a9c-4a34-8ed5-1ed1c582afea" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.384360] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c005ff21-4a9c-4a34-8ed5-1ed1c582afea',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.888046] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.888046] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.888243] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.888442] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.888590] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.888741] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port c005ff21-4a9c-4a34-8ed5-1ed1c582afea not found, creating... [ 797.888997] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.889204] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.889330] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.889551] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.889687] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.889962] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.890125] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.890333] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.890961] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.890961] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.890961] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: c005ff21-4a9c-4a34-8ed5-1ed1c582afea is going to be created. [ 797.914769] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.915025] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.915025] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.915359] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.916018] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.916018] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-c005ff21-4a9c-4a34-8ed5-1ed1c582afea" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.713948] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 798.714216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.053232] env[70535]: INFO networking_nsxv3.common.synchronization [req-16e6b19e-0d81-4ed8-8e9b-00b39601bd83 req-572dec02-b660-43db-80e0-139085ab041f service nova] Enqueued Resource ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 with Priority: HIGHEST for action security_group_rules [ 799.053232] env[70535]: INFO networking_nsxv3.common.synchronization [req-16e6b19e-0d81-4ed8-8e9b-00b39601bd83 req-572dec02-b660-43db-80e0-139085ab041f service nova] Enqueued Resource ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 with Priority: HIGHEST for action security_group_members [ 799.053232] env[70535]: INFO networking_nsxv3.common.synchronization [req-16e6b19e-0d81-4ed8-8e9b-00b39601bd83 req-572dec02-b660-43db-80e0-139085ab041f service nova] Enqueued Resource ID: c005ff21-4a9c-4a34-8ed5-1ed1c582afea with Priority: HIGHEST for action port [ 799.053232] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 with Priority: HIGHEST for action security_group_rules [ 799.053232] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 with Priority: HIGHEST for action security_group_members [ 799.053494] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c005ff21-4a9c-4a34-8ed5-1ed1c582afea with Priority: HIGHEST for action port [ 799.053566] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.053702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.053774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.053979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.054293] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46eec3ed-88a9-4ea1-a649-2f92efa91eb5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.056043] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.058215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.058321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.058476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.058627] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.058725] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.058785] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.058930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.059027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.059142] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46eec3ed-88a9-4ea1-a649-2f92efa91eb5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.060852] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-c005ff21-4a9c-4a34-8ed5-1ed1c582afea taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.062813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c005ff21-4a9c-4a34-8ed5-1ed1c582afea" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.063081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c005ff21-4a9c-4a34-8ed5-1ed1c582afea" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.063420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c005ff21-4a9c-4a34-8ed5-1ed1c582afea" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.063557] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c005ff21-4a9c-4a34-8ed5-1ed1c582afea',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.321203] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89135034-9b45-4344-b065-0229db08f4f9 in Status: SUCCESS [ 799.321461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.322100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.322100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.322228] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.322305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.322305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.322592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.322592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.322682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.322765] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89135034-9b45-4344-b065-0229db08f4f9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.566158] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.566351] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.566574] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46eec3ed-88a9-4ea1-a649-2f92efa91eb5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.567589] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c005ff21-4a9c-4a34-8ed5-1ed1c582afea with status ACTIVE [ 799.567772] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.567921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.567991] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.568217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.568360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.568750] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.568750] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.568904] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.568980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.569594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.569815] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.570043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.570143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.570430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.570565] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.570717] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c005ff21-4a9c-4a34-8ed5-1ed1c582afea is going to be updated. [ 799.610108] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.610278] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.610349] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.610603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.610741] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.610916] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c005ff21-4a9c-4a34-8ed5-1ed1c582afea" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.828150] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89135034-9b45-4344-b065-0229db08f4f9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.916529] env[70535]: INFO networking_nsxv3.common.synchronization [req-285af49a-b99f-4090-822a-2e255dfc0318 req-a8c78cc6-45b6-4099-82e8-47ff48e2a99d tempest-VolumesAdminNegativeTest-1297223157 tempest-VolumesAdminNegativeTest-1297223157-project-member] Enqueued Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGHEST for action security_group_members [ 799.917032] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGHEST for action security_group_members [ 799.917472] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-b05014f4-0d5c-444e-a37c-dbe58f585d75 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.917472] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.917604] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.918361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.918361] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.920454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.920570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.920774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.920836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.920934] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b05014f4-0d5c-444e-a37c-dbe58f585d75',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.076536] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46eec3ed-88a9-4ea1-a649-2f92efa91eb5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.332624] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89135034-9b45-4344-b065-0229db08f4f9: rpc.has_security_group_logging(os_id): False [ 800.358464] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.358642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.358690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.358923] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.359089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.359340] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.359464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.359565] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.359724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.359832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.359941] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89135034-9b45-4344-b065-0229db08f4f9 is going to be created. [ 800.423637] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.423637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.423637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.424048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.424048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.425800] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.425800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.425800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.425800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.425800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.425800] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 already deleted. [ 800.425800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.449101] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.449101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.449101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.449309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.449562] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.468718] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89135034-9b45-4344-b065-0229db08f4f9 in Status: IN_PROGRESS for 2s [ 800.519021] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-339 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.519021] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-339" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.519021] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-339" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.519021] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-339" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.519021] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.519021] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.519575] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.519904] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.520179] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.520535] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 800.520771] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 800.521338] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 800.521583] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 800.523030] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 800.523030] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 800.523030] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 800.543966] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 800.544166] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 800.544282] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 800.544453] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-339" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.544768] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-895d12ae-4aaf-4afd-a13f-1ad147bbee50 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.544935] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-895d12ae-4aaf-4afd-a13f-1ad147bbee50" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.546403] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-895d12ae-4aaf-4afd-a13f-1ad147bbee50" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.546906] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-895d12ae-4aaf-4afd-a13f-1ad147bbee50" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.547075] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('895d12ae-4aaf-4afd-a13f-1ad147bbee50',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.582309] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.582456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.582522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.582733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.582890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.582999] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 is going to be created. [ 800.612119] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.612119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.612119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.612119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.612355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.627521] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 in Status: UNINITIALIZED for 2s [ 801.058147] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.058147] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.058147] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.058147] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.058147] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.058147] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 895d12ae-4aaf-4afd-a13f-1ad147bbee50 not found, creating... [ 801.058147] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.058147] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.058147] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.058147] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.058147] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.058912] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.058912] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.058912] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.058912] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.058912] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.058912] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 895d12ae-4aaf-4afd-a13f-1ad147bbee50 is going to be created. [ 801.082461] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.084832] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.084832] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.084832] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.084832] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.084832] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-895d12ae-4aaf-4afd-a13f-1ad147bbee50" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.015219] env[70535]: INFO networking_nsxv3.common.synchronization [req-285af49a-b99f-4090-822a-2e255dfc0318 req-86dedbd7-a200-4260-9eb6-3f9f9e33da4d service nova] Enqueued Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGHEST for action security_group_rules [ 802.015327] env[70535]: INFO networking_nsxv3.common.synchronization [req-285af49a-b99f-4090-822a-2e255dfc0318 req-86dedbd7-a200-4260-9eb6-3f9f9e33da4d service nova] Enqueued Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGHEST for action security_group_members [ 802.015433] env[70535]: INFO networking_nsxv3.common.synchronization [req-285af49a-b99f-4090-822a-2e255dfc0318 req-86dedbd7-a200-4260-9eb6-3f9f9e33da4d service nova] Enqueued Resource ID: 895d12ae-4aaf-4afd-a13f-1ad147bbee50 with Priority: HIGHEST for action port [ 802.015790] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGHEST for action security_group_rules [ 802.015824] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGHEST for action security_group_members [ 802.015937] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 895d12ae-4aaf-4afd-a13f-1ad147bbee50 with Priority: HIGHEST for action port [ 802.017322] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b05014f4-0d5c-444e-a37c-dbe58f585d75 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.017322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.017322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.017543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.017543] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b05014f4-0d5c-444e-a37c-dbe58f585d75',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.022029] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-b05014f4-0d5c-444e-a37c-dbe58f585d75 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.022029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.022029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.022029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.022029] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.022029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.022029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.022029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.022029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.022029] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b05014f4-0d5c-444e-a37c-dbe58f585d75',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.022029] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-895d12ae-4aaf-4afd-a13f-1ad147bbee50 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.022029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-895d12ae-4aaf-4afd-a13f-1ad147bbee50" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.022029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-895d12ae-4aaf-4afd-a13f-1ad147bbee50" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.022029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-895d12ae-4aaf-4afd-a13f-1ad147bbee50" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.022029] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('895d12ae-4aaf-4afd-a13f-1ad147bbee50',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.356070] env[70535]: INFO networking_nsxv3.common.synchronization [req-f9909407-15c3-4a3a-94b8-8ffe655de06b req-dd3f9276-7bd3-4020-94d9-5b60ecf34264 tempest-ServerActionsV293TestJSON-1453434710 tempest-ServerActionsV293TestJSON-1453434710-project-member] Enqueued Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGHEST for action security_group_members [ 802.356698] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGHEST for action security_group_members [ 802.357324] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9244c40-b3c3-42a1-af4b-33b8585c25ed taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.357699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.357944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.358452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.358832] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.359191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.359429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.359807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.360455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.361138] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9244c40-b3c3-42a1-af4b-33b8585c25ed',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.434177] env[70535]: INFO networking_nsxv3.common.synchronization [None req-e82e679b-5f47-4c96-a9e2-b58db5cda901 None None] Enqueued Resource ID: 1448fa05-d048-4b99-9ee5-2bd0e2334141 with Priority: HIGHEST for action port [ 802.434177] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1448fa05-d048-4b99-9ee5-2bd0e2334141 with Priority: HIGHEST for action port [ 802.434177] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-1448fa05-d048-4b99-9ee5-2bd0e2334141 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.434177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1448fa05-d048-4b99-9ee5-2bd0e2334141" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.435122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1448fa05-d048-4b99-9ee5-2bd0e2334141" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.436160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1448fa05-d048-4b99-9ee5-2bd0e2334141" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.436160] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1448fa05-d048-4b99-9ee5-2bd0e2334141',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.514737] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89135034-9b45-4344-b065-0229db08f4f9 in Status: SUCCESS [ 802.515159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.525230] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b05014f4-0d5c-444e-a37c-dbe58f585d75',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.530045] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-b05014f4-0d5c-444e-a37c-dbe58f585d75 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.530045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.530045] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 895d12ae-4aaf-4afd-a13f-1ad147bbee50 with status ACTIVE [ 802.530045] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.530045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.530045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.530045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.530045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.530045] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.530045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.530045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.530045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.530045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.530045] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.530874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.530874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.530874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.530874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.530874] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 895d12ae-4aaf-4afd-a13f-1ad147bbee50 is going to be updated. [ 802.557145] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.558240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.558240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.558240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.558426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.558505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-895d12ae-4aaf-4afd-a13f-1ad147bbee50" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.639076] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 in Status: SUCCESS [ 802.639537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.639761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.640218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.640457] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.640654] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.640718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.640990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.641191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.641399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.641857] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46eec3ed-88a9-4ea1-a649-2f92efa91eb5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.862041] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-169 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.862309] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-169" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.862393] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-169" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.862837] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-169" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.863147] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.863327] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.863479] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.863774] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.863916] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.864161] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 802.864285] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.864416] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.864531] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.864655] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 802.864777] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.864953] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.868037] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.868592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.868592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.868592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.868592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.868800] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.868800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.870148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.870353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.870445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.870540] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed already deleted. [ 802.870626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.891107] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.891307] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 802.891787] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.891889] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-169" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.892232] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-696dd423-c5af-495c-beda-2774c0b02532 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.892411] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-696dd423-c5af-495c-beda-2774c0b02532" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.892530] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-696dd423-c5af-495c-beda-2774c0b02532" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.892850] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-696dd423-c5af-495c-beda-2774c0b02532" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.893083] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('696dd423-c5af-495c-beda-2774c0b02532',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.939804] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1448fa05-d048-4b99-9ee5-2bd0e2334141 [ 802.939804] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.939804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.939804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.939804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.940187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.940275] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1448fa05-d048-4b99-9ee5-2bd0e2334141 already deleted. [ 802.940376] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1448fa05-d048-4b99-9ee5-2bd0e2334141" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.027975] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b05014f4-0d5c-444e-a37c-dbe58f585d75',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.144823] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46eec3ed-88a9-4ea1-a649-2f92efa91eb5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.398893] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.403076] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.403076] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.403076] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.403271] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.403825] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 696dd423-c5af-495c-beda-2774c0b02532 not found, creating... [ 803.403825] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.403999] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.404687] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.405703] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.405703] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.406085] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.406267] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.406444] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.406678] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.407388] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.407388] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 696dd423-c5af-495c-beda-2774c0b02532 is going to be created. [ 803.429534] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.429756] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.429894] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.430218] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.431061] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.431061] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-696dd423-c5af-495c-beda-2774c0b02532" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.531199] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.531812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.531972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.532238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.532341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.532823] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 is going to be created. [ 803.578256] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.578467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.578569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.578840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.579097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.599493] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 in Status: UNINITIALIZED for 2s [ 803.648019] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46eec3ed-88a9-4ea1-a649-2f92efa91eb5: rpc.has_security_group_logging(os_id): False [ 803.668789] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.668969] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.669041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.669229] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.669321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.669564] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.669727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.669727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.669890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.669974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.670089] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 is going to be created. [ 803.737834] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.737987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.737987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.738358] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.738358] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.750583] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 in Status: IN_PROGRESS for 2s [ 804.937139] env[70535]: INFO networking_nsxv3.common.synchronization [req-f9909407-15c3-4a3a-94b8-8ffe655de06b req-40d8595f-3447-4bcd-8714-fee44fe4c049 service nova] Enqueued Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGHEST for action security_group_rules [ 804.937139] env[70535]: INFO networking_nsxv3.common.synchronization [req-f9909407-15c3-4a3a-94b8-8ffe655de06b req-40d8595f-3447-4bcd-8714-fee44fe4c049 service nova] Enqueued Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGHEST for action security_group_members [ 804.937632] env[70535]: INFO networking_nsxv3.common.synchronization [req-f9909407-15c3-4a3a-94b8-8ffe655de06b req-40d8595f-3447-4bcd-8714-fee44fe4c049 service nova] Enqueued Resource ID: 696dd423-c5af-495c-beda-2774c0b02532 with Priority: HIGHEST for action port [ 804.937832] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGHEST for action security_group_rules [ 804.938046] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGHEST for action security_group_members [ 804.938746] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 696dd423-c5af-495c-beda-2774c0b02532 with Priority: HIGHEST for action port [ 804.939749] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.939972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.940167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.940532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.940702] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9244c40-b3c3-42a1-af4b-33b8585c25ed',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.942099] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9244c40-b3c3-42a1-af4b-33b8585c25ed taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.942166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.942256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.942582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.942727] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.942875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.943195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.943445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.943590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.943793] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9244c40-b3c3-42a1-af4b-33b8585c25ed',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.944906] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-696dd423-c5af-495c-beda-2774c0b02532 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.945039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-696dd423-c5af-495c-beda-2774c0b02532" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.945136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-696dd423-c5af-495c-beda-2774c0b02532" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.945403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-696dd423-c5af-495c-beda-2774c0b02532" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.945540] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('696dd423-c5af-495c-beda-2774c0b02532',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.995603] env[70535]: INFO networking_nsxv3.common.synchronization [req-4d7c6757-6d8f-4a51-9188-75163131b960 req-96c81df0-b4af-4bdf-8bd6-98766c2b6f14 tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_members [ 804.996364] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_members [ 804.996712] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.996847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.996918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.997209] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.997372] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.997477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.997555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.999302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.999302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.999302] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.028853] env[70535]: INFO networking_nsxv3.common.synchronization [None req-82a3ab6b-0155-43e1-8168-a8e7ff52b90a None None] Enqueued Resource ID: 0318e276-ceae-4264-827a-cc88c460cc19 with Priority: HIGHEST for action port [ 805.029697] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0318e276-ceae-4264-827a-cc88c460cc19 with Priority: HIGHEST for action port [ 805.031064] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-0318e276-ceae-4264-827a-cc88c460cc19 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.031064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0318e276-ceae-4264-827a-cc88c460cc19" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.031293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0318e276-ceae-4264-827a-cc88c460cc19" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.031464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0318e276-ceae-4264-827a-cc88c460cc19" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.031547] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0318e276-ceae-4264-827a-cc88c460cc19',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.448467] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9244c40-b3c3-42a1-af4b-33b8585c25ed',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.451685] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9244c40-b3c3-42a1-af4b-33b8585c25ed taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.451685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.451685] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 696dd423-c5af-495c-beda-2774c0b02532 with status ACTIVE [ 805.451685] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.451685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.451685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.451685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.451685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.452780] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.455325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.455325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.455325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.455325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.455325] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.455325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.455325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.455325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.455325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.455325] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 696dd423-c5af-495c-beda-2774c0b02532 is going to be updated. [ 805.485768] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.485942] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.486026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.486243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.486385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.487036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-696dd423-c5af-495c-beda-2774c0b02532" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.502163] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.505462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.505462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.505462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.505462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.505462] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.505462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.505462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.505812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.505812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.505812] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 is going to be updated. [ 805.534020] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0318e276-ceae-4264-827a-cc88c460cc19 [ 805.535035] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.535035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.535035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.535252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.535252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.535428] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0318e276-ceae-4264-827a-cc88c460cc19 already deleted. [ 805.535460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0318e276-ceae-4264-827a-cc88c460cc19" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.547680] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.548098] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.548216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.548442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.548586] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.566348] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 in Status: IN_PROGRESS for 2s [ 805.614523] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 in Status: SUCCESS [ 805.614866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.615068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.615321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.615537] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.615663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.615728] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.615899] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.615989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.616087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.616182] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b05014f4-0d5c-444e-a37c-dbe58f585d75',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.767142] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 in Status: SUCCESS [ 805.767368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.867241] env[70535]: INFO networking_nsxv3.common.synchronization [req-dad1fae9-5f02-4c07-9fb9-329f1ebc4e01 req-43797fa2-744c-4289-92f4-bae05d857d58 tempest-TenantUsagesTestJSON-729091640 tempest-TenantUsagesTestJSON-729091640-project-member] Enqueued Resource ID: a61a906f-165f-4ddb-98ee-a6437a47d544 with Priority: HIGHEST for action security_group_members [ 805.867814] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61a906f-165f-4ddb-98ee-a6437a47d544 with Priority: HIGHEST for action security_group_members [ 805.869060] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-a61a906f-165f-4ddb-98ee-a6437a47d544 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.869060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.869060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.869060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.869060] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.869060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.869060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.869485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.869485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.869485] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a61a906f-165f-4ddb-98ee-a6437a47d544',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.951067] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9244c40-b3c3-42a1-af4b-33b8585c25ed',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.121262] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b05014f4-0d5c-444e-a37c-dbe58f585d75',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.357289] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.357611] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.357762] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.358144] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.359050] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.359261] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.359390] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.359635] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.359787] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.360015] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.360144] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.360255] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.360366] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.360480] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.360587] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.360722] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.373303] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.373470] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.373470] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.373699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.373852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.374335] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.374335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.374335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.374544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.374682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.374744] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a61a906f-165f-4ddb-98ee-a6437a47d544 already deleted. [ 806.374826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.384395] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.384590] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 806.385247] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.385506] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.385890] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-a4b8822b-76d7-4123-ae43-d3ae3537ff24 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.386096] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-a4b8822b-76d7-4123-ae43-d3ae3537ff24" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.386242] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-a4b8822b-76d7-4123-ae43-d3ae3537ff24" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.386597] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-a4b8822b-76d7-4123-ae43-d3ae3537ff24" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.386754] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4b8822b-76d7-4123-ae43-d3ae3537ff24',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.454573] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.454573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.454573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.454573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.454887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.454887] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed is going to be created. [ 806.515825] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.516024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.516334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.516429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.516589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.527559] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed in Status: UNINITIALIZED for 2s [ 806.626621] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b05014f4-0d5c-444e-a37c-dbe58f585d75: rpc.has_security_group_logging(os_id): False [ 806.648322] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.648650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.648734] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.648922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.649033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.649367] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.649484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.649542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.649717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.649803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.649958] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 is going to be created. [ 806.713257] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.713257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.713477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.713671] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.713796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.760364] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 in Status: IN_PROGRESS for 2s [ 806.895023] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.895023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.895023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.895023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.895023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.895023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port a4b8822b-76d7-4123-ae43-d3ae3537ff24 not found, creating... [ 806.895023] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.895023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.895023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.895023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.895023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.895542] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.895542] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.895542] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.895542] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.895673] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.895778] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: a4b8822b-76d7-4123-ae43-d3ae3537ff24 is going to be created. [ 806.928041] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.928647] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.928647] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.928770] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.929261] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.929261] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-a4b8822b-76d7-4123-ae43-d3ae3537ff24" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.578145] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 in Status: SUCCESS [ 807.578145] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 deletion is rescheduled due to dependency. [ 807.578145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.765629] env[70535]: INFO networking_nsxv3.common.synchronization [req-dad1fae9-5f02-4c07-9fb9-329f1ebc4e01 req-5f1bf751-0d71-4638-82bc-383b100e667a service nova] Enqueued Resource ID: a61a906f-165f-4ddb-98ee-a6437a47d544 with Priority: HIGHEST for action security_group_rules [ 807.765629] env[70535]: INFO networking_nsxv3.common.synchronization [req-dad1fae9-5f02-4c07-9fb9-329f1ebc4e01 req-5f1bf751-0d71-4638-82bc-383b100e667a service nova] Enqueued Resource ID: a61a906f-165f-4ddb-98ee-a6437a47d544 with Priority: HIGHEST for action security_group_members [ 807.765735] env[70535]: INFO networking_nsxv3.common.synchronization [req-dad1fae9-5f02-4c07-9fb9-329f1ebc4e01 req-5f1bf751-0d71-4638-82bc-383b100e667a service nova] Enqueued Resource ID: a4b8822b-76d7-4123-ae43-d3ae3537ff24 with Priority: HIGHEST for action port [ 807.765971] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61a906f-165f-4ddb-98ee-a6437a47d544 with Priority: HIGHEST for action security_group_rules [ 807.766118] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61a906f-165f-4ddb-98ee-a6437a47d544 with Priority: HIGHEST for action security_group_members [ 807.766248] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4b8822b-76d7-4123-ae43-d3ae3537ff24 with Priority: HIGHEST for action port [ 807.766837] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a61a906f-165f-4ddb-98ee-a6437a47d544 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.766967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.768089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.768392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.768483] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a61a906f-165f-4ddb-98ee-a6437a47d544',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.771251] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-a61a906f-165f-4ddb-98ee-a6437a47d544 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.771251] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.771251] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.771418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.771494] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.771593] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.771651] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.771822] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.771927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.773200] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a61a906f-165f-4ddb-98ee-a6437a47d544',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.773200] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4b8822b-76d7-4123-ae43-d3ae3537ff24 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.773200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4b8822b-76d7-4123-ae43-d3ae3537ff24" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.773200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4b8822b-76d7-4123-ae43-d3ae3537ff24" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.773600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4b8822b-76d7-4123-ae43-d3ae3537ff24" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.773675] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4b8822b-76d7-4123-ae43-d3ae3537ff24',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.275703] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-a61a906f-165f-4ddb-98ee-a6437a47d544 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.275901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.276020] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a61a906f-165f-4ddb-98ee-a6437a47d544',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.276997] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4b8822b-76d7-4123-ae43-d3ae3537ff24 with status ACTIVE [ 808.277301] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.277498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.279168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.279473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.279592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.279826] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.279943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.280017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.280257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.282415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.282415] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.282415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.282415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.282415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.282415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.282415] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4b8822b-76d7-4123-ae43-d3ae3537ff24 is going to be updated. [ 808.305106] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.305298] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.305385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.305636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.305819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.306014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4b8822b-76d7-4123-ae43-d3ae3537ff24" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.516126] env[70535]: INFO networking_nsxv3.common.synchronization [req-a5a9e67c-0d7d-49e8-ad98-b8f4d4da2a00 req-ea47549e-fd03-4dfb-96db-4b8f863de0a4 tempest-ImagesOneServerNegativeTestJSON-495716502 tempest-ImagesOneServerNegativeTestJSON-495716502-project-member] Enqueued Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 808.516818] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 808.517265] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.517412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.517483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.517743] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.517899] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.518068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.518068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.519115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.519115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.519115] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.541270] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed in Status: SUCCESS [ 808.541915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.542166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.542421] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.544424] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.544424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.544424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.544424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.544424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.544424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.544424] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9244c40-b3c3-42a1-af4b-33b8585c25ed',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.774294] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 in Status: SUCCESS [ 808.774704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.783644] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a61a906f-165f-4ddb-98ee-a6437a47d544',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.022189] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.022189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.022189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.022392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.022392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.022597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.022696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.022764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.022914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.022990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.023088] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50631980-025e-4f7c-a21a-486351e09d1f already deleted. [ 809.023233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.048322] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9244c40-b3c3-42a1-af4b-33b8585c25ed',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.174259] env[70535]: INFO networking_nsxv3.common.synchronization [req-c97839d6-e7b1-4394-9995-28cd8c4410c8 req-428320d7-e1a6-41f7-818b-0f315c07391c tempest-AttachInterfacesUnderV243Test-1177928744 tempest-AttachInterfacesUnderV243Test-1177928744-project-member] Enqueued Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_members [ 809.174808] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_members [ 809.175170] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf92eefc-a553-4c8e-a807-3110974b4799 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.175316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.175407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.175669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.175850] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.175970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.179163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.179415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.179520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.179628] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.268687] env[70535]: INFO networking_nsxv3.common.synchronization [req-c97839d6-e7b1-4394-9995-28cd8c4410c8 req-428320d7-e1a6-41f7-818b-0f315c07391c tempest-AttachInterfacesUnderV243Test-1177928744 tempest-AttachInterfacesUnderV243Test-1177928744-project-member] Enqueued Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_rules [ 809.268687] env[70535]: INFO networking_nsxv3.common.synchronization [req-c97839d6-e7b1-4394-9995-28cd8c4410c8 req-428320d7-e1a6-41f7-818b-0f315c07391c tempest-AttachInterfacesUnderV243Test-1177928744 tempest-AttachInterfacesUnderV243Test-1177928744-project-member] Enqueued Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_members [ 809.268687] env[70535]: INFO networking_nsxv3.common.synchronization [req-c97839d6-e7b1-4394-9995-28cd8c4410c8 req-428320d7-e1a6-41f7-818b-0f315c07391c tempest-AttachInterfacesUnderV243Test-1177928744 tempest-AttachInterfacesUnderV243Test-1177928744-project-member] Enqueued Resource ID: 601c9f06-1cc1-4e4d-8b6f-763d07559dad with Priority: HIGHEST for action port [ 809.269855] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_rules [ 809.270180] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_members [ 809.273022] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 601c9f06-1cc1-4e4d-8b6f-763d07559dad with Priority: HIGHEST for action port [ 809.273022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf92eefc-a553-4c8e-a807-3110974b4799 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.273022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.273022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.273022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.273022] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.273022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf92eefc-a553-4c8e-a807-3110974b4799 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.273022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.273022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-601c9f06-1cc1-4e4d-8b6f-763d07559dad taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.273022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.273022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.273022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.274160] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('601c9f06-1cc1-4e4d-8b6f-763d07559dad',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.289866] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.289866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.289866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.289866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.289866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.289866] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a61a906f-165f-4ddb-98ee-a6437a47d544 is going to be created. [ 809.319166] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.320452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.320452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.320595] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.320774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.333262] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a61a906f-165f-4ddb-98ee-a6437a47d544 in Status: UNINITIALIZED for 2s [ 809.410710] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-198 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.411128] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-198" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.411816] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-198" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.412040] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-198" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.412536] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.412828] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.413071] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.413773] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.414136] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.414481] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.414691] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.414913] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.415151] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.415358] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.415575] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.415791] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.441522] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.441522] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 809.441732] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.441843] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-198" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.442513] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-010f802b-a86f-4e3e-8c3f-392d4a58d50d taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.442513] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-010f802b-a86f-4e3e-8c3f-392d4a58d50d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.442705] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-010f802b-a86f-4e3e-8c3f-392d4a58d50d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.443354] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-010f802b-a86f-4e3e-8c3f-392d4a58d50d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.443456] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('010f802b-a86f-4e3e-8c3f-392d4a58d50d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.550111] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9244c40-b3c3-42a1-af4b-33b8585c25ed: rpc.has_security_group_logging(os_id): False [ 809.578725] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.579022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.579022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.579219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.579266] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.579735] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.579735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.579735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.583307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.583307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.583307] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed is going to be created. [ 809.667850] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.668062] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.668062] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.668286] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.668475] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.683049] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed in Status: IN_PROGRESS for 2s [ 809.687395] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.776081] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf92eefc-a553-4c8e-a807-3110974b4799 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.776500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.776500] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 601c9f06-1cc1-4e4d-8b6f-763d07559dad with status ACTIVE [ 809.776747] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.776812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.776889] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.777171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.777299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.777469] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.777617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.777681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.778094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.778094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.778210] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.778285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.778285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.778432] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.778506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.778590] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 601c9f06-1cc1-4e4d-8b6f-763d07559dad is going to be updated. [ 809.858515] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.858515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.858515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.858515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.858854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.858854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.948022] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.948022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.948022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.948022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.948022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.948022] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 010f802b-a86f-4e3e-8c3f-392d4a58d50d not found, creating... [ 809.948593] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.948593] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.948593] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.948903] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.950312] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.950925] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.950925] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.950925] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.951455] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.951455] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.951588] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 010f802b-a86f-4e3e-8c3f-392d4a58d50d is going to be created. [ 809.994876] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.995613] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.997226] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.997566] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.997827] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.998111] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-010f802b-a86f-4e3e-8c3f-392d4a58d50d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.190389] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.693402] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.694616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.694766] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.695084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.695210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.695322] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf92eefc-a553-4c8e-a807-3110974b4799 is going to be updated. [ 810.752447] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.752689] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.752689] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.753451] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.753728] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.768259] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf92eefc-a553-4c8e-a807-3110974b4799 in Status: IN_PROGRESS for 2s [ 810.978315] env[70535]: INFO networking_nsxv3.common.synchronization [req-cbfdae38-391b-4258-aed8-d0407103d9cd req-0f25d5a3-d9ea-44a6-8a66-943992c533ee tempest-ServerRescueTestJSONUnderV235-1149632473 tempest-ServerRescueTestJSONUnderV235-1149632473-project-member] Enqueued Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_members [ 810.979401] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_members [ 810.979850] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.980153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.980321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.980660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.980923] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.981157] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.981402] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.981845] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.982087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.982323] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.031617] env[70535]: INFO networking_nsxv3.common.synchronization [req-a5a9e67c-0d7d-49e8-ad98-b8f4d4da2a00 req-8a4a4ad7-469a-4043-a477-a0ddc5a7146a service nova] Enqueued Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_rules [ 811.031617] env[70535]: INFO networking_nsxv3.common.synchronization [req-a5a9e67c-0d7d-49e8-ad98-b8f4d4da2a00 req-8a4a4ad7-469a-4043-a477-a0ddc5a7146a service nova] Enqueued Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 811.031617] env[70535]: INFO networking_nsxv3.common.synchronization [req-a5a9e67c-0d7d-49e8-ad98-b8f4d4da2a00 req-8a4a4ad7-469a-4043-a477-a0ddc5a7146a service nova] Enqueued Resource ID: 010f802b-a86f-4e3e-8c3f-392d4a58d50d with Priority: HIGHEST for action port [ 811.031617] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_rules [ 811.032075] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 811.032370] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010f802b-a86f-4e3e-8c3f-392d4a58d50d with Priority: HIGHEST for action port [ 811.035097] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.035097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.035097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.035097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.035097] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.038345] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.038720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.038899] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.039222] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.039491] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.039927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.040107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.040368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.041614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.041614] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.042590] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-010f802b-a86f-4e3e-8c3f-392d4a58d50d taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.042956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-010f802b-a86f-4e3e-8c3f-392d4a58d50d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.043109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-010f802b-a86f-4e3e-8c3f-392d4a58d50d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.043379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-010f802b-a86f-4e3e-8c3f-392d4a58d50d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.043566] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('010f802b-a86f-4e3e-8c3f-392d4a58d50d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.345938] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a61a906f-165f-4ddb-98ee-a6437a47d544 in Status: SUCCESS [ 811.345938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.345938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.345938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.346204] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.346204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.346204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.347534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.347534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.347534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.347534] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a61a906f-165f-4ddb-98ee-a6437a47d544',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.449370] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-161 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.449577] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-161" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.449701] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-161" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.450042] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-161" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.450305] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.450964] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.450964] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.450964] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.450964] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.451175] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 811.451320] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 811.451515] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 811.451597] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 811.452310] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 811.452310] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 811.452310] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 811.472948] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 811.475628] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 811.475628] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 811.475628] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-161" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.475628] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-6a60fcfb-c252-4f89-8ab1-623a21d155f1 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.475628] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.475628] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.475628] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.475628] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a60fcfb-c252-4f89-8ab1-623a21d155f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.488807] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.488807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.488807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.488807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.488807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.488807] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.488807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.488807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.488807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.488807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.488807] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a already deleted. [ 811.488807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.544381] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.547522] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.547522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.547522] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 010f802b-a86f-4e3e-8c3f-392d4a58d50d with status ACTIVE [ 811.547522] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.547522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.547522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.547522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.547522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.547522] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.547522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.547522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.547522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.547522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.548281] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.548281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.548281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.548379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.548379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.550087] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 010f802b-a86f-4e3e-8c3f-392d4a58d50d is going to be updated. [ 811.589096] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.589096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.589096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.589382] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.589382] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.590067] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-010f802b-a86f-4e3e-8c3f-392d4a58d50d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.712782] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed in Status: SUCCESS [ 811.712782] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.849583] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-a61a906f-165f-4ddb-98ee-a6437a47d544 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.850537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.850537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.850900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.851579] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.851579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.851579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.851579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.851579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.851819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.852067] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-a61a906f-165f-4ddb-98ee-a6437a47d544 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.852191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.852305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.852625] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.852953] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.852953] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.853216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.853423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.853588] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.853686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.853912] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a61a906f-165f-4ddb-98ee-a6437a47d544',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.981025] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.981025] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.981025] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.981025] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.981025] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.981025] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 6a60fcfb-c252-4f89-8ab1-623a21d155f1 not found, creating... [ 811.981025] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.981025] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.981025] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.981025] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.981025] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.981722] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.981722] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.981722] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.981722] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.982655] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.983025] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 6a60fcfb-c252-4f89-8ab1-623a21d155f1 is going to be created. [ 812.011267] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.011504] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.011713] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.011915] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.012167] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.012768] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.050782] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.357427] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a61a906f-165f-4ddb-98ee-a6437a47d544: rpc.has_security_group_logging(os_id): False [ 812.378027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.378234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.378295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.378638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.378638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.378896] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.378993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.378993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.379151] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.379233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.379439] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.379558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.379639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.379757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.379845] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.380037] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.380131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.380190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.380331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.380420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.380493] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a61a906f-165f-4ddb-98ee-a6437a47d544 is going to be created. [ 812.450578] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.450696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.450751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.450956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.451253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.466727] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a61a906f-165f-4ddb-98ee-a6437a47d544 in Status: IN_PROGRESS for 2s [ 812.553303] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.553470] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.553570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.553979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.553979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.554097] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50631980-025e-4f7c-a21a-486351e09d1f is going to be created. [ 812.585404] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.585617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.585617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.585808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.586069] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.618657] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: UNINITIALIZED for 2s [ 812.646607] env[70535]: INFO networking_nsxv3.common.synchronization [req-6efc56af-c515-4847-aadc-f35434a47a41 req-8784cde1-6a57-4ada-bc94-d21b81381905 tempest-AttachInterfacesUnderV243Test-1177928744 tempest-AttachInterfacesUnderV243Test-1177928744-project-member] Enqueued Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_members [ 812.647282] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_members [ 812.647847] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf92eefc-a553-4c8e-a807-3110974b4799 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.647847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.665758] env[70535]: INFO networking_nsxv3.common.synchronization [req-6efc56af-c515-4847-aadc-f35434a47a41 req-8784cde1-6a57-4ada-bc94-d21b81381905 tempest-AttachInterfacesUnderV243Test-1177928744 tempest-AttachInterfacesUnderV243Test-1177928744-project-member] Enqueued Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_rules [ 812.667338] env[70535]: INFO networking_nsxv3.common.synchronization [req-6efc56af-c515-4847-aadc-f35434a47a41 req-8784cde1-6a57-4ada-bc94-d21b81381905 tempest-AttachInterfacesUnderV243Test-1177928744 tempest-AttachInterfacesUnderV243Test-1177928744-project-member] Enqueued Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_members [ 812.667691] env[70535]: INFO networking_nsxv3.common.synchronization [req-6efc56af-c515-4847-aadc-f35434a47a41 req-8784cde1-6a57-4ada-bc94-d21b81381905 tempest-AttachInterfacesUnderV243Test-1177928744 tempest-AttachInterfacesUnderV243Test-1177928744-project-member] Enqueued Resource ID: 601c9f06-1cc1-4e4d-8b6f-763d07559dad with Priority: HIGHEST for action port [ 812.672547] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_rules [ 812.672547] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_members [ 812.672547] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 601c9f06-1cc1-4e4d-8b6f-763d07559dad with Priority: HIGHEST for action port [ 812.672547] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf92eefc-a553-4c8e-a807-3110974b4799 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.672547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.672547] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf92eefc-a553-4c8e-a807-3110974b4799 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.672547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.672547] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-601c9f06-1cc1-4e4d-8b6f-763d07559dad taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.672547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.672547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.672547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.672547] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('601c9f06-1cc1-4e4d-8b6f-763d07559dad',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.780771] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf92eefc-a553-4c8e-a807-3110974b4799 in Status: SUCCESS [ 812.781618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.782059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.782826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.783195] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.783450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.783583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.786364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.786364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.786364] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.883678] env[70535]: INFO networking_nsxv3.common.synchronization [req-cbfdae38-391b-4258-aed8-d0407103d9cd req-569a371c-ba62-4b89-b1e5-95f73a442364 service nova] Enqueued Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_rules [ 812.884114] env[70535]: INFO networking_nsxv3.common.synchronization [req-cbfdae38-391b-4258-aed8-d0407103d9cd req-569a371c-ba62-4b89-b1e5-95f73a442364 service nova] Enqueued Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_members [ 812.884355] env[70535]: INFO networking_nsxv3.common.synchronization [req-cbfdae38-391b-4258-aed8-d0407103d9cd req-569a371c-ba62-4b89-b1e5-95f73a442364 service nova] Enqueued Resource ID: 6a60fcfb-c252-4f89-8ab1-623a21d155f1 with Priority: HIGHEST for action port [ 812.887854] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_rules [ 812.887988] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_members [ 812.888118] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a60fcfb-c252-4f89-8ab1-623a21d155f1 with Priority: HIGHEST for action port [ 812.888784] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.888924] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.889103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.889362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.889451] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.892277] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.892441] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.892509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.892835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.893372] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.893494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.893559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.893734] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.893921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.894060] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.897765] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a60fcfb-c252-4f89-8ab1-623a21d155f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.897765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.897765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.898367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.898535] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a60fcfb-c252-4f89-8ab1-623a21d155f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.176516] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 601c9f06-1cc1-4e4d-8b6f-763d07559dad with status ACTIVE [ 813.176822] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.177401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.177401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.177401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.177517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.178644] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.178644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.178644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.178644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.178644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.178644] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.178644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.178644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.179211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.179211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.179211] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 601c9f06-1cc1-4e4d-8b6f-763d07559dad is going to be updated. [ 813.230700] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.230956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.231107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.231428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.231668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.231941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-601c9f06-1cc1-4e4d-8b6f-763d07559dad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.290420] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.401810] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.402091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.403033] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.404054] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a60fcfb-c252-4f89-8ab1-623a21d155f1 with status ACTIVE [ 813.404054] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.404280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.404280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.404727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.404851] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.405114] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.405235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.405328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.405543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.405661] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.405880] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.406051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.406130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.406331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.406431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.410409] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a60fcfb-c252-4f89-8ab1-623a21d155f1 is going to be updated. [ 813.439181] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.439181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.439181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.439971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.440146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.440323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.793447] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.913932] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.296424] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.296869] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.296869] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.297043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.297286] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.297286] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf92eefc-a553-4c8e-a807-3110974b4799 is going to be updated. [ 814.334496] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.334754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.334754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.335035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.335262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.348277] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf92eefc-a553-4c8e-a807-3110974b4799 in Status: IN_PROGRESS for 2s [ 814.417210] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.417428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.417428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.417648] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.417760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.417868] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a is going to be created. [ 814.461463] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.461663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.461703] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.461956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.462145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.477245] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: UNINITIALIZED for 2s [ 814.479772] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a61a906f-165f-4ddb-98ee-a6437a47d544 in Status: SUCCESS [ 814.479998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.630693] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: SUCCESS [ 814.631300] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.631300] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.631300] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.631569] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.631569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.631569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.631726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.631832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.631928] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.632033] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.137620] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.138758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.138758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.138758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.138758] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.139059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.139059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.139165] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.139234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.139284] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.139433] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.139530] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.139615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.139727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.140613] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.140613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.140613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.140613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.140613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.140613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.140613] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.643205] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50631980-025e-4f7c-a21a-486351e09d1f: rpc.has_security_group_logging(os_id): False [ 815.666651] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.666815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.666913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.667286] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.667441] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.667734] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.667917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.668049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.668310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.668460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.668930] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.669142] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.669260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.669453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.669633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.669827] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.669967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.670071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.670256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.670369] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.670489] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50631980-025e-4f7c-a21a-486351e09d1f is going to be created. [ 815.743823] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.743823] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.744134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.744270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.744496] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.762025] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: IN_PROGRESS for 2s [ 816.358136] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf92eefc-a553-4c8e-a807-3110974b4799 in Status: SUCCESS [ 816.358361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.358534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.358760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.358967] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.359112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.359180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.359338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.359424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.359509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.359611] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.360613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.360786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.360954] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.361077] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.361142] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.361286] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.361367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.361462] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.488416] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: SUCCESS [ 816.488650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.488815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.489042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.489240] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.489356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.489420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.489585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.489667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.489753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.489845] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.867478] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.868652] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.968042] env[70535]: INFO networking_nsxv3.common.synchronization [req-2f0a3509-a7cc-468a-b7be-0bb71a480b32 req-efb0fc89-8d89-40c4-a724-86b9419b6651 tempest-AttachInterfacesUnderV243Test-1177928744 tempest-AttachInterfacesUnderV243Test-1177928744-project-member] Enqueued Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_members [ 816.968598] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf92eefc-a553-4c8e-a807-3110974b4799 with Priority: HIGHEST for action security_group_members [ 816.968906] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf92eefc-a553-4c8e-a807-3110974b4799 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.970073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.994789] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.998578] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.998578] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.998578] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.998578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.999540] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.999540] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.371678] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf92eefc-a553-4c8e-a807-3110974b4799: rpc.has_security_group_logging(os_id): False [ 817.374754] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.399048] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.399048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.399048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.399048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.399048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.399048] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.399048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.399048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.399048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.399048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.399048] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf92eefc-a553-4c8e-a807-3110974b4799 is going to be updated. [ 817.466514] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.467556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.467556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.467556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.467556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.481863] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf92eefc-a553-4c8e-a807-3110974b4799 in Status: IN_PROGRESS for 2s [ 817.499306] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ea29cae-e57a-45bc-881e-d2a221f2801a: rpc.has_security_group_logging(os_id): False [ 817.532021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.532239] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.532292] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.532538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.532587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.532745] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.532856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.532908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.533061] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.533140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.533344] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.533436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.533490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.533636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.533707] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.533895] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.536864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.536864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.537016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.537108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.537223] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a is going to be created. [ 817.624613] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.624794] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.624872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.625110] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.625370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.641454] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: IN_PROGRESS for 2s [ 817.796647] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: SUCCESS [ 817.796923] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.879188] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.879188] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.879188] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.879188] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.879188] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.879188] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf92eefc-a553-4c8e-a807-3110974b4799 is going to be updated. [ 817.929869] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.930101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.930101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.930315] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.930455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.942613] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf92eefc-a553-4c8e-a807-3110974b4799 in Status: IN_PROGRESS for 2s [ 818.140587] env[70535]: INFO networking_nsxv3.common.synchronization [req-370f0ae5-fd43-41fe-8166-150402890592 req-5200bf0a-990f-4abc-a86a-1e0325ba4348 tempest-ListImageFiltersTestJSON-1844606616 tempest-ListImageFiltersTestJSON-1844606616-project-member] Enqueued Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_members [ 818.141146] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGHEST for action security_group_members [ 818.141476] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.141606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.141754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.141921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.142225] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.142316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.142367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.142519] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.142610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.142851] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.646522] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.646713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.646757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.647159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.647159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.647297] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.647372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.647410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.647566] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.647646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.647732] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 is going to be updated. [ 818.679209] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.679349] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.679416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.679632] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.679766] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.690612] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: IN_PROGRESS for 2s [ 819.188188] env[70535]: INFO networking_nsxv3.common.synchronization [req-a5c07ab9-88bd-42ab-8ba7-dee8d7c315ad req-ef7dc240-f723-470e-a011-5aba2b60b1de tempest-ServersV294TestFqdnHostnames-734776706 tempest-ServersV294TestFqdnHostnames-734776706-project-member] Enqueued Resource ID: ce0ae195-bd66-418b-89e1-33b9dece1034 with Priority: HIGHEST for action security_group_members [ 819.188188] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce0ae195-bd66-418b-89e1-33b9dece1034 with Priority: HIGHEST for action security_group_members [ 819.188188] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce0ae195-bd66-418b-89e1-33b9dece1034 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.188984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.191392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.191392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.191392] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.191392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.191392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.191392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.191392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.191392] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce0ae195-bd66-418b-89e1-33b9dece1034',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.502255] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf92eefc-a553-4c8e-a807-3110974b4799 in Status: SUCCESS [ 819.502690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.503063] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.503522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.503688] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.653250] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: SUCCESS [ 819.654323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.696461] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.696461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.696461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.696461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.696461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.696461] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.696461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.696461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.696461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.696461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.696461] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce0ae195-bd66-418b-89e1-33b9dece1034 is going to be updated. [ 819.727205] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.727205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.727205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.727205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.727205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.737276] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce0ae195-bd66-418b-89e1-33b9dece1034 in Status: IN_PROGRESS for 2s [ 819.836036] env[70535]: INFO networking_nsxv3.common.synchronization [req-9bb43b16-9a12-4748-9940-0da384af5100 req-4fb031a4-1a79-4663-864d-404a55ba6863 tempest-ImagesTestJSON-1564979202 tempest-ImagesTestJSON-1564979202-project-member] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 819.836036] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 819.836036] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.836606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.836843] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.837161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.840426] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.840426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.840426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.840426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.840426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.840426] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.953503] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf92eefc-a553-4c8e-a807-3110974b4799 in Status: SUCCESS [ 819.953742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.953943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.954221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.954416] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.954537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.954605] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.954769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.954915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.955061] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.032060] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.032304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.032397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.032659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.032778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.032903] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf92eefc-a553-4c8e-a807-3110974b4799 is going to be deleted. [ 820.093466] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.093466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.093466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.093466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.093466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.093466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.342030] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.342307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.342307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.342507] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.342756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.342931] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.343089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.343264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.343463] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.343572] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.343700] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 820.379396] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.379577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.379692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.380073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.380250] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.390988] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 820.457718] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.457946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.457946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.458979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.458979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.458979] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.458979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.458979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.458979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.458979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.458979] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf92eefc-a553-4c8e-a807-3110974b4799 is going to be deleted. [ 820.521326] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.521589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.521589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.521812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.521910] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.522304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.522304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.522591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.522681] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.522785] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.522854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.523017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.523106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.523202] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf92eefc-a553-4c8e-a807-3110974b4799',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.701792] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 in Status: SUCCESS [ 820.701989] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 deletion is rescheduled due to dependency. [ 820.702107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.026324] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.026324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.026581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.026814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.026903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.027114] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.027218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.027280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.027425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.027494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.027575] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf92eefc-a553-4c8e-a807-3110974b4799 already deleted. [ 821.027650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf92eefc-a553-4c8e-a807-3110974b4799" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.456325] env[70535]: INFO networking_nsxv3.common.synchronization [req-fb298405-c3ed-4837-9abc-56432c7c4245 req-712f9223-3ae3-4238-bd3e-b6b2beb282cf tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 821.456805] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 821.457119] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.457252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.457348] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.457622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.457782] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.457884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.459176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.459373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.459482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.459568] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.753110] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce0ae195-bd66-418b-89e1-33b9dece1034 in Status: SUCCESS [ 821.753326] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce0ae195-bd66-418b-89e1-33b9dece1034 deletion is rescheduled due to dependency. [ 821.753449] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.854935] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.855151] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.855600] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.855600] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.855853] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.856017] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.857308] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.858099] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.858099] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.858319] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.858492] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.858648] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.858823] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.859074] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.859279] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.859524] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.881244] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.881450] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 821.881579] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.881816] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.882301] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-2471e91a-8e3f-4ce2-8926-1a0ba8439e5e taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.882501] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-2471e91a-8e3f-4ce2-8926-1a0ba8439e5e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.882743] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-2471e91a-8e3f-4ce2-8926-1a0ba8439e5e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.883211] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-2471e91a-8e3f-4ce2-8926-1a0ba8439e5e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.883710] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2471e91a-8e3f-4ce2-8926-1a0ba8439e5e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.963191] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.963191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.963191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.963191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.963191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.963191] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.963191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.963191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.963191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.963191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.963191] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b already deleted. [ 821.963191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.386189] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.386529] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.386695] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.387233] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.387233] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.387398] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 2471e91a-8e3f-4ce2-8926-1a0ba8439e5e not found, creating... [ 822.387611] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.391083] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.391224] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.391518] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.391699] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.396163] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.396563] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.396715] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.397050] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.397224] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.397391] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 2471e91a-8e3f-4ce2-8926-1a0ba8439e5e is going to be created. [ 822.420327] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 822.420549] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e deletion is rescheduled due to dependency. [ 822.420623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.434845] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.435082] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.435218] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.435480] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.435716] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.436028] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-2471e91a-8e3f-4ce2-8926-1a0ba8439e5e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.218448] env[70535]: INFO networking_nsxv3.common.synchronization [req-fb298405-c3ed-4837-9abc-56432c7c4245 req-ef3c55f1-6830-489c-a2ff-03995e4287c3 service nova] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_rules [ 823.219466] env[70535]: INFO networking_nsxv3.common.synchronization [req-fb298405-c3ed-4837-9abc-56432c7c4245 req-ef3c55f1-6830-489c-a2ff-03995e4287c3 service nova] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 823.219466] env[70535]: INFO networking_nsxv3.common.synchronization [req-fb298405-c3ed-4837-9abc-56432c7c4245 req-ef3c55f1-6830-489c-a2ff-03995e4287c3 service nova] Enqueued Resource ID: 2471e91a-8e3f-4ce2-8926-1a0ba8439e5e with Priority: HIGHEST for action port [ 823.219466] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_rules [ 823.219466] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 823.219466] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2471e91a-8e3f-4ce2-8926-1a0ba8439e5e with Priority: HIGHEST for action port [ 823.221454] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.222167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.222167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.222167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.222167] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.225549] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.229804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.229804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.229804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.229804] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.229804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.229804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.229804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.229804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.229804] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.230572] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-2471e91a-8e3f-4ce2-8926-1a0ba8439e5e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.230642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2471e91a-8e3f-4ce2-8926-1a0ba8439e5e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.230704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2471e91a-8e3f-4ce2-8926-1a0ba8439e5e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.230857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2471e91a-8e3f-4ce2-8926-1a0ba8439e5e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.230940] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2471e91a-8e3f-4ce2-8926-1a0ba8439e5e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.565148] env[70535]: INFO networking_nsxv3.common.synchronization [None req-93a07753-87a6-4b54-b156-e521223005d5 None None] Enqueued Resource ID: dbeb5e9b-403b-4250-afae-b6c199584e76 with Priority: HIGHEST for action port [ 823.566102] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb5e9b-403b-4250-afae-b6c199584e76 with Priority: HIGHEST for action port [ 823.567528] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbeb5e9b-403b-4250-afae-b6c199584e76 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.567724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbeb5e9b-403b-4250-afae-b6c199584e76" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.567786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbeb5e9b-403b-4250-afae-b6c199584e76" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.568016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbeb5e9b-403b-4250-afae-b6c199584e76" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.568120] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbeb5e9b-403b-4250-afae-b6c199584e76',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.735386] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.735512] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.735637] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.736688] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2471e91a-8e3f-4ce2-8926-1a0ba8439e5e with status ACTIVE [ 823.736850] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.736972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.737054] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.737279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.737374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.737559] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.737662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.737714] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.738413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.738413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.741791] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.741949] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.742065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.742235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.742323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.742418] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2471e91a-8e3f-4ce2-8926-1a0ba8439e5e is going to be updated. [ 823.755420] env[70535]: INFO networking_nsxv3.common.synchronization [req-c6dfa53c-a756-4c8b-9dea-06883bc8baea req-29947ac6-a29e-4140-91c1-408b4288635e tempest-TenantUsagesTestJSON-729091640 tempest-TenantUsagesTestJSON-729091640-project-member] Enqueued Resource ID: a61a906f-165f-4ddb-98ee-a6437a47d544 with Priority: HIGHEST for action security_group_members [ 823.757179] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61a906f-165f-4ddb-98ee-a6437a47d544 with Priority: HIGHEST for action security_group_members [ 823.759208] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-a61a906f-165f-4ddb-98ee-a6437a47d544 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.759412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.759491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.759706] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.759921] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.760042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.760111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.760272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.760606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.760606] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a61a906f-165f-4ddb-98ee-a6437a47d544',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.766675] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.766819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.766888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.768081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.768081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.768081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2471e91a-8e3f-4ce2-8926-1a0ba8439e5e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.071326] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbeb5e9b-403b-4250-afae-b6c199584e76 [ 824.071574] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.071712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.071779] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.072073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.072267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.072382] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbeb5e9b-403b-4250-afae-b6c199584e76 already deleted. [ 824.072478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbeb5e9b-403b-4250-afae-b6c199584e76" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.245428] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.263036] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.263214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.263299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.263501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.263593] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.263791] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.263907] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.263958] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.264189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.264275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.264362] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a61a906f-165f-4ddb-98ee-a6437a47d544 is going to be updated. [ 824.296347] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.296539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.296578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.297029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.297029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.307584] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a61a906f-165f-4ddb-98ee-a6437a47d544 in Status: IN_PROGRESS for 2s [ 824.748442] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.748614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.748678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.748909] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.749012] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.749120] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be created. [ 824.778141] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.778357] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.778427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.778589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.778777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.794502] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: UNINITIALIZED for 2s [ 826.110215] env[70535]: INFO networking_nsxv3.common.synchronization [None req-a97141c0-5dd2-4353-9a63-808b8ab9ad0b None None] Enqueued Resource ID: f822eb26-13e7-4f05-8ed0-01412359ab5c with Priority: HIGHEST for action port [ 826.110547] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f822eb26-13e7-4f05-8ed0-01412359ab5c with Priority: HIGHEST for action port [ 826.111074] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-f822eb26-13e7-4f05-8ed0-01412359ab5c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.111314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f822eb26-13e7-4f05-8ed0-01412359ab5c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.111314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f822eb26-13e7-4f05-8ed0-01412359ab5c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.111694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f822eb26-13e7-4f05-8ed0-01412359ab5c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.111694] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f822eb26-13e7-4f05-8ed0-01412359ab5c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.316067] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a61a906f-165f-4ddb-98ee-a6437a47d544 in Status: SUCCESS [ 826.316248] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a61a906f-165f-4ddb-98ee-a6437a47d544 deletion is rescheduled due to dependency. [ 826.316368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.616607] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f822eb26-13e7-4f05-8ed0-01412359ab5c [ 826.616951] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.617186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.617293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.617633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.617772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.617919] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f822eb26-13e7-4f05-8ed0-01412359ab5c already deleted. [ 826.618078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f822eb26-13e7-4f05-8ed0-01412359ab5c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.808209] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 826.808534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.808845] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.809106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.809382] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.809551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.809660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.809946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.809998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.810125] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.810248] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.312681] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.313060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.313060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.313204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.313300] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.313443] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.313501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.313631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.313716] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.313965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.313965] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.314199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.314199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.314283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.314576] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.314576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.314576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.314729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.314807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.315570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.315570] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.818298] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63056e22-45eb-4c1b-b65b-578fb5876c5b: rpc.has_security_group_logging(os_id): False [ 827.836843] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.836994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.837078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.837325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.837435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.837713] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.837838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.837932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.838168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.838285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.838550] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.838949] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.838949] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.838949] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.839080] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.839218] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.839335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.839388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.839540] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.839618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.839749] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be created. [ 827.900843] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.901046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.901133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.901456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.901456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.913252] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: IN_PROGRESS for 2s [ 828.554359] env[70535]: INFO networking_nsxv3.common.synchronization [req-7afc2e2b-0ade-4aa7-af61-c04db485992b req-12edc6fc-1cd6-4e1e-8306-aa4a0078f9b0 tempest-ServersAdminTestJSON-1221450413 tempest-ServersAdminTestJSON-1221450413-project-member] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 828.554359] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 828.554359] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.554764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.554764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.554883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.554993] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.555133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.555212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.555398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.555489] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.555601] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.030145] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-39 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.030586] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.030678] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.031562] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.032068] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.032706] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.032706] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.032706] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.033228] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.033531] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.033741] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.033940] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.034091] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.034291] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.034346] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.035766] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.059562] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.059562] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 829.059809] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.060401] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.060401] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-de251fd2-87e6-4411-962b-4c42a254d994 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.060723] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-de251fd2-87e6-4411-962b-4c42a254d994" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.060761] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-de251fd2-87e6-4411-962b-4c42a254d994" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.061079] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-de251fd2-87e6-4411-962b-4c42a254d994" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.062845] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de251fd2-87e6-4411-962b-4c42a254d994',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.062845] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.565913] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.566509] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.566799] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.567217] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.567755] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.567755] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.567755] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port de251fd2-87e6-4411-962b-4c42a254d994 not found, creating... [ 829.568153] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.568674] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.568674] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.568758] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.569391] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.569391] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.569544] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.569664] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.569894] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.570061] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.570217] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: de251fd2-87e6-4411-962b-4c42a254d994 is going to be created. [ 829.593323] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.593779] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.593779] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.594317] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.594391] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.594652] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-de251fd2-87e6-4411-962b-4c42a254d994" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.927593] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 829.927981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.072513] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.072694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.072743] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.072969] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.073085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.073192] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be updated. [ 830.119896] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.120155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.120293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.120616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.120903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.133928] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: IN_PROGRESS for 2s [ 830.380859] env[70535]: INFO networking_nsxv3.common.synchronization [req-7afc2e2b-0ade-4aa7-af61-c04db485992b req-21f905ad-6ca7-4c26-a34f-3e04a9c99955 service nova] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_rules [ 830.380859] env[70535]: INFO networking_nsxv3.common.synchronization [req-7afc2e2b-0ade-4aa7-af61-c04db485992b req-21f905ad-6ca7-4c26-a34f-3e04a9c99955 service nova] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 830.381253] env[70535]: INFO networking_nsxv3.common.synchronization [req-7afc2e2b-0ade-4aa7-af61-c04db485992b req-21f905ad-6ca7-4c26-a34f-3e04a9c99955 service nova] Enqueued Resource ID: de251fd2-87e6-4411-962b-4c42a254d994 with Priority: HIGHEST for action port [ 830.381519] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_rules [ 830.381662] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 830.381756] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de251fd2-87e6-4411-962b-4c42a254d994 with Priority: HIGHEST for action port [ 830.383377] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.383377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.383377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.383377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.383377] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.384759] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.384886] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.385231] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-de251fd2-87e6-4411-962b-4c42a254d994 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.385356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de251fd2-87e6-4411-962b-4c42a254d994" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.385440] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de251fd2-87e6-4411-962b-4c42a254d994" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.385699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de251fd2-87e6-4411-962b-4c42a254d994" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.385738] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de251fd2-87e6-4411-962b-4c42a254d994',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.888758] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.889077] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.891339] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de251fd2-87e6-4411-962b-4c42a254d994 with status ACTIVE [ 830.891577] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.891704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.891783] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.892051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.892129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.892296] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.893092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.893092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.893092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.893092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.893092] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.893092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.893092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.893527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.893527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.893527] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de251fd2-87e6-4411-962b-4c42a254d994 is going to be updated. [ 830.917359] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.917584] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.917722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.918026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.918199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.918386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de251fd2-87e6-4411-962b-4c42a254d994" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.144369] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 832.144774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.145077] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.145362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.145601] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.145824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.145920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.146826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.146826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.147075] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.379207] env[70535]: INFO networking_nsxv3.common.synchronization [req-eed0841f-ba02-4778-992c-5b9c60389e56 req-05d35cbb-ab9c-430b-9dee-9ca919a30024 tempest-ServerGroupTestJSON-1023642755 tempest-ServerGroupTestJSON-1023642755-project-member] Enqueued Resource ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c with Priority: HIGHEST for action security_group_members [ 832.379858] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c with Priority: HIGHEST for action security_group_members [ 832.380250] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.380410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.388856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.392485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.392485] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.392485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.392485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.392485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.392485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.392485] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2476f5f-d3ef-49eb-bade-f2adb005ec7c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.410989] env[70535]: INFO networking_nsxv3.common.synchronization [req-529359c6-2004-47c5-9ff9-8d3b4d73067c req-236c4f5b-3d92-4de3-b43e-5f6657dc3e1e tempest-ServerRescueTestJSONUnderV235-1149632473 tempest-ServerRescueTestJSONUnderV235-1149632473-project-member] Enqueued Resource ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f with Priority: HIGHEST for action security_group_members [ 832.410989] env[70535]: INFO networking_nsxv3.common.synchronization [req-529359c6-2004-47c5-9ff9-8d3b4d73067c req-236c4f5b-3d92-4de3-b43e-5f6657dc3e1e tempest-ServerRescueTestJSONUnderV235-1149632473 tempest-ServerRescueTestJSONUnderV235-1149632473-project-member] Enqueued Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_members [ 832.411516] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f with Priority: HIGHEST for action security_group_members [ 832.411773] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_members [ 832.415819] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9db10f55-ced7-42e6-b2f3-a1fde607f58f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.415819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.415819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.415819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.417759] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.417759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.417759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.418043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.418043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.418173] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9db10f55-ced7-42e6-b2f3-a1fde607f58f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.422602] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.422808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.423321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.423321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.423393] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.423615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.424685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.424685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.424685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.424685] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.509796] env[70535]: INFO networking_nsxv3.common.synchronization [req-529359c6-2004-47c5-9ff9-8d3b4d73067c req-236c4f5b-3d92-4de3-b43e-5f6657dc3e1e tempest-ServerRescueTestJSONUnderV235-1149632473 tempest-ServerRescueTestJSONUnderV235-1149632473-project-member] Enqueued Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_rules [ 832.510455] env[70535]: INFO networking_nsxv3.common.synchronization [req-529359c6-2004-47c5-9ff9-8d3b4d73067c req-236c4f5b-3d92-4de3-b43e-5f6657dc3e1e tempest-ServerRescueTestJSONUnderV235-1149632473 tempest-ServerRescueTestJSONUnderV235-1149632473-project-member] Enqueued Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_members [ 832.510455] env[70535]: INFO networking_nsxv3.common.synchronization [req-529359c6-2004-47c5-9ff9-8d3b4d73067c req-236c4f5b-3d92-4de3-b43e-5f6657dc3e1e tempest-ServerRescueTestJSONUnderV235-1149632473 tempest-ServerRescueTestJSONUnderV235-1149632473-project-member] Enqueued Resource ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f with Priority: HIGHEST for action security_group_rules [ 832.510455] env[70535]: INFO networking_nsxv3.common.synchronization [req-529359c6-2004-47c5-9ff9-8d3b4d73067c req-236c4f5b-3d92-4de3-b43e-5f6657dc3e1e tempest-ServerRescueTestJSONUnderV235-1149632473 tempest-ServerRescueTestJSONUnderV235-1149632473-project-member] Enqueued Resource ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f with Priority: HIGHEST for action security_group_members [ 832.510455] env[70535]: INFO networking_nsxv3.common.synchronization [req-529359c6-2004-47c5-9ff9-8d3b4d73067c req-236c4f5b-3d92-4de3-b43e-5f6657dc3e1e tempest-ServerRescueTestJSONUnderV235-1149632473 tempest-ServerRescueTestJSONUnderV235-1149632473-project-member] Enqueued Resource ID: 6a60fcfb-c252-4f89-8ab1-623a21d155f1 with Priority: HIGHEST for action port [ 832.511224] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_rules [ 832.511341] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f with Priority: HIGHEST for action security_group_rules [ 832.511450] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a60fcfb-c252-4f89-8ab1-623a21d155f1 with Priority: HIGHEST for action port [ 832.511543] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_members [ 832.511632] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f with Priority: HIGHEST for action security_group_members [ 832.511975] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.512294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.512294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.512404] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.512483] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.513733] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9db10f55-ced7-42e6-b2f3-a1fde607f58f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.514240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.514240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.514240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.518203] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9db10f55-ced7-42e6-b2f3-a1fde607f58f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.518203] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a60fcfb-c252-4f89-8ab1-623a21d155f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.518203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.518203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.518203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.518203] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a60fcfb-c252-4f89-8ab1-623a21d155f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.518203] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.518203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.518203] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9db10f55-ced7-42e6-b2f3-a1fde607f58f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.518203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.649943] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.895679] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.897649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.897917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.898231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.899739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.899739] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.899739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.899739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.899739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.899739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.899739] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c already deleted. [ 832.899739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.923136] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9db10f55-ced7-42e6-b2f3-a1fde607f58f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.928362] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.017851] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.018019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.020484] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9db10f55-ced7-42e6-b2f3-a1fde607f58f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.020611] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.020746] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a60fcfb-c252-4f89-8ab1-623a21d155f1 with status ACTIVE [ 833.020898] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.021026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.021076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.022931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.022931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.022931] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.022931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.022931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.022931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.022931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.022931] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.022931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.022931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.022931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.022931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.022931] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a60fcfb-c252-4f89-8ab1-623a21d155f1 is going to be updated. [ 833.045378] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.045585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.045639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.045875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.046029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.046192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.145999] env[70535]: INFO networking_nsxv3.common.synchronization [req-27af5596-a20a-4ecf-bb25-4ee464d7f278 req-92ea3880-b8c3-48b7-985b-7ef744fdca64 tempest-ServerRescueTestJSONUnderV235-1149632473 tempest-ServerRescueTestJSONUnderV235-1149632473-project-member] Enqueued Resource ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f with Priority: HIGHEST for action security_group_members [ 833.146399] env[70535]: INFO networking_nsxv3.common.synchronization [req-27af5596-a20a-4ecf-bb25-4ee464d7f278 req-92ea3880-b8c3-48b7-985b-7ef744fdca64 tempest-ServerRescueTestJSONUnderV235-1149632473 tempest-ServerRescueTestJSONUnderV235-1149632473-project-member] Enqueued Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_members [ 833.148713] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f with Priority: HIGHEST for action security_group_members [ 833.148713] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_members [ 833.148713] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9db10f55-ced7-42e6-b2f3-a1fde607f58f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.148713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.148713] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.148713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.151980] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.207090] env[70535]: INFO networking_nsxv3.common.synchronization [req-27af5596-a20a-4ecf-bb25-4ee464d7f278 req-92ea3880-b8c3-48b7-985b-7ef744fdca64 tempest-ServerRescueTestJSONUnderV235-1149632473 tempest-ServerRescueTestJSONUnderV235-1149632473-project-member] Enqueued Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_rules [ 833.207271] env[70535]: INFO networking_nsxv3.common.synchronization [req-27af5596-a20a-4ecf-bb25-4ee464d7f278 req-92ea3880-b8c3-48b7-985b-7ef744fdca64 tempest-ServerRescueTestJSONUnderV235-1149632473 tempest-ServerRescueTestJSONUnderV235-1149632473-project-member] Enqueued Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_members [ 833.207413] env[70535]: INFO networking_nsxv3.common.synchronization [req-27af5596-a20a-4ecf-bb25-4ee464d7f278 req-92ea3880-b8c3-48b7-985b-7ef744fdca64 tempest-ServerRescueTestJSONUnderV235-1149632473 tempest-ServerRescueTestJSONUnderV235-1149632473-project-member] Enqueued Resource ID: 6a60fcfb-c252-4f89-8ab1-623a21d155f1 with Priority: HIGHEST for action port [ 833.207986] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_rules [ 833.208137] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_members [ 833.208248] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a60fcfb-c252-4f89-8ab1-623a21d155f1 with Priority: HIGHEST for action port [ 833.208689] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.208807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.209023] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.209101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.209280] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a60fcfb-c252-4f89-8ab1-623a21d155f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.209383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.209470] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.209690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.209774] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a60fcfb-c252-4f89-8ab1-623a21d155f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.425606] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9db10f55-ced7-42e6-b2f3-a1fde607f58f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.430729] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.654442] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.654719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.654762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.655162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.655162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.655267] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be updated. [ 833.662362] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-549 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.662362] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-549" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.662637] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-549" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.662827] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-549" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.664416] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.664640] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.664781] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.665057] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.665243] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.665474] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.665593] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.665716] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.666626] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.666626] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.666626] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.666626] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.684756] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.686565] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 833.686769] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.686991] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-549" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.687352] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-866cf8c8-0121-4af6-bafc-dd339bc528d4 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.687553] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-866cf8c8-0121-4af6-bafc-dd339bc528d4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.687696] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-866cf8c8-0121-4af6-bafc-dd339bc528d4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.688079] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-866cf8c8-0121-4af6-bafc-dd339bc528d4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.688246] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('866cf8c8-0121-4af6-bafc-dd339bc528d4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.694247] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.694477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.694477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.694711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.695019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.706583] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: IN_PROGRESS for 2s [ 833.714620] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a60fcfb-c252-4f89-8ab1-623a21d155f1 with status ACTIVE [ 833.714905] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.715088] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.715187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.715439] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.715533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.715722] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.715828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.715890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.716054] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.716157] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.716343] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.716494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.716574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.716721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.716810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.716897] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a60fcfb-c252-4f89-8ab1-623a21d155f1 is going to be updated. [ 833.746575] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.746575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.746575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.746575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.746575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.746575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a60fcfb-c252-4f89-8ab1-623a21d155f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.928129] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.928328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.928461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.928633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.928725] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.928816] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f is going to be created. [ 833.933753] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.934626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.934626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.934626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.934626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.934626] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a is going to be updated. [ 833.959114] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.959214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.959249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.959501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.959667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.967367] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.967628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.967628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.967853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.968049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.972920] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f in Status: UNINITIALIZED for 2s [ 833.981736] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: IN_PROGRESS for 2s [ 834.196754] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.196754] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.196754] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.196754] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.196754] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.196754] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 866cf8c8-0121-4af6-bafc-dd339bc528d4 not found, creating... [ 834.196754] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.196754] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.196754] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.196754] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.196754] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.199033] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.199555] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.199974] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.200444] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.201378] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.201378] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 866cf8c8-0121-4af6-bafc-dd339bc528d4 is going to be created. [ 834.228445] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.228681] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.228841] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.229164] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.229477] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.229782] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-866cf8c8-0121-4af6-bafc-dd339bc528d4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.304734] env[70535]: INFO networking_nsxv3.common.synchronization [req-eed0841f-ba02-4778-992c-5b9c60389e56 req-2a112fe9-1731-4b2c-908f-8373b4974fb8 service nova] Enqueued Resource ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c with Priority: HIGHEST for action security_group_rules [ 835.305100] env[70535]: INFO networking_nsxv3.common.synchronization [req-eed0841f-ba02-4778-992c-5b9c60389e56 req-2a112fe9-1731-4b2c-908f-8373b4974fb8 service nova] Enqueued Resource ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c with Priority: HIGHEST for action security_group_members [ 835.305100] env[70535]: INFO networking_nsxv3.common.synchronization [req-eed0841f-ba02-4778-992c-5b9c60389e56 req-2a112fe9-1731-4b2c-908f-8373b4974fb8 service nova] Enqueued Resource ID: 866cf8c8-0121-4af6-bafc-dd339bc528d4 with Priority: HIGHEST for action port [ 835.305688] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c with Priority: HIGHEST for action security_group_rules [ 835.305830] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c with Priority: HIGHEST for action security_group_members [ 835.306012] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 866cf8c8-0121-4af6-bafc-dd339bc528d4 with Priority: HIGHEST for action port [ 835.306722] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2476f5f-d3ef-49eb-bade-f2adb005ec7c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.306847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.306941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.307253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.307378] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2476f5f-d3ef-49eb-bade-f2adb005ec7c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.308596] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.308772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.308865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.309105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.309502] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.309665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.309753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.309955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.310086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.310210] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2476f5f-d3ef-49eb-bade-f2adb005ec7c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.311226] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-866cf8c8-0121-4af6-bafc-dd339bc528d4 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.311432] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-866cf8c8-0121-4af6-bafc-dd339bc528d4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.311549] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-866cf8c8-0121-4af6-bafc-dd339bc528d4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.311767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-866cf8c8-0121-4af6-bafc-dd339bc528d4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.312309] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('866cf8c8-0121-4af6-bafc-dd339bc528d4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.720332] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 835.720601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.722497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.722497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.722497] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.722497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.722497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.722497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.722497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.722497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.722497] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.813794] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2476f5f-d3ef-49eb-bade-f2adb005ec7c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.816028] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.816028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.816297] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 866cf8c8-0121-4af6-bafc-dd339bc528d4 with status ACTIVE [ 835.816538] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.816699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.816765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.816978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.817082] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.817266] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.817382] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.817442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.817561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.817635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.817808] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.817896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.818044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.818090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.818174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.818243] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 866cf8c8-0121-4af6-bafc-dd339bc528d4 is going to be updated. [ 835.858766] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.858968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.859131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.859401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.859630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.859921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-866cf8c8-0121-4af6-bafc-dd339bc528d4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.985555] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f in Status: SUCCESS [ 835.985628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.986872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.986872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.986872] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.986872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.986872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.986872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.986872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.986872] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9db10f55-ced7-42e6-b2f3-a1fde607f58f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.997885] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: SUCCESS [ 835.998225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.999921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.999921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.999921] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.999921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.999921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.999921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.999921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.999921] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.098234] env[70535]: INFO networking_nsxv3.common.synchronization [req-cd4bc7d7-aaf9-4771-bdce-e9e5bbc50655 req-b1eff78b-5ebc-40d9-86f5-ab15638133a7 tempest-ServersTestBootFromVolume-979772703 tempest-ServersTestBootFromVolume-979772703-project-member] Enqueued Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGHEST for action security_group_members [ 836.098234] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGHEST for action security_group_members [ 836.098234] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b11bca7-ad54-4a56-a651-3a19b70ab917 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.099038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.099152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.099425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.099613] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.099720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.099785] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.099955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.100047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.100141] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b11bca7-ad54-4a56-a651-3a19b70ab917',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.228990] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.228990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.228990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.229309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.229309] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.229431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.229498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.229715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.229896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.229956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.230550] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.230550] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.230550] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.230550] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.230776] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.230776] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.230776] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.230909] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.230951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.234030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.234030] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.321991] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2476f5f-d3ef-49eb-bade-f2adb005ec7c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.493027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.493027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.493027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.493027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.493027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.493027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.493027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.493027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.493027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.493027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.493027] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f is going to be deleted. [ 836.504152] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.530651] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.530922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.530922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.531131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.531222] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.531324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.531488] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.531643] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.531811] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.531908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.531992] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.532166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.532287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.532474] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9db10f55-ced7-42e6-b2f3-a1fde607f58f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.603303] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.603303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.603303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.603303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.603303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.603613] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.603613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.603613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.603809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.603809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.603964] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 already deleted. [ 836.604128] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.733944] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f32aa9cd-fe8f-4b69-8037-59fa1cf6570c: rpc.has_security_group_logging(os_id): False [ 836.756022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.756022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.756022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.756022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.756022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.756022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.756022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.756022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.756022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.756022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.756022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.756022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.756022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.756022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.756022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.756657] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.756657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.757186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.757539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.759244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.759244] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be updated. [ 836.806022] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-469 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.806022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-469" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.806022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-469" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.806022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-469" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.806865] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.807845] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.807845] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.808066] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.808959] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.808959] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.808959] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.809293] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.809537] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.810082] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.811100] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.811100] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.827056] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.827056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.827056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.827056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.827056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.827056] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c is going to be created. [ 836.831298] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.831526] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 836.831730] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.831985] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-469" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.832431] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-bb949cb2-5601-4623-99f5-30d023ee6b8f taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.832664] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-bb949cb2-5601-4623-99f5-30d023ee6b8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.832835] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-bb949cb2-5601-4623-99f5-30d023ee6b8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.833509] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-bb949cb2-5601-4623-99f5-30d023ee6b8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.833762] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb949cb2-5601-4623-99f5-30d023ee6b8f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.840537] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.841452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.841818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.841818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.841962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.856018] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: IN_PROGRESS for 2s [ 836.863625] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.864153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.864644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.864644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.864755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.877272] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c in Status: UNINITIALIZED for 2s [ 837.001794] env[70535]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] NSXv3 Agent Agent loop - iteration:0 completed [ 837.001794] env[70535]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] NSXv3 Agent Agent loop - iteration:1 started [ 837.006890] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.039078] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.039274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.039315] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.039549] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.039646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.039883] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.039992] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.040082] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.040256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.040329] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.040419] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f already deleted. [ 837.040505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.040809] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9db10f55-ced7-42e6-b2f3-a1fde607f58f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.041573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.041750] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.041909] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.042164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.042284] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.042560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.042715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.042887] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9db10f55-ced7-42e6-b2f3-a1fde607f58f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.067029] env[70535]: INFO networking_nsxv3.common.synchronization [req-b512661c-bc08-4fea-923a-51dbf12ed141 req-bac6e560-7d2b-4d46-9a05-c1050f2ab2cc tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 837.067029] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 837.067029] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.067029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.067029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.067029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.067029] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.067029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.067029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.067029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.067029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.067029] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.337327] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.339908] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.340171] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.340488] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.340633] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.340799] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port bb949cb2-5601-4623-99f5-30d023ee6b8f not found, creating... [ 837.341102] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.341271] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.343019] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.343019] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.343019] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.343019] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.343019] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.343019] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.343019] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.343019] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.343601] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: bb949cb2-5601-4623-99f5-30d023ee6b8f is going to be created. [ 837.370143] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.370643] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.370721] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.371129] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.371475] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.371773] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-bb949cb2-5601-4623-99f5-30d023ee6b8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.511471] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.511471] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.511471] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.511471] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.511471] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.511471] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a is going to be updated. [ 837.545138] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9db10f55-ced7-42e6-b2f3-a1fde607f58f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.546497] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.546712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.546712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.548186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.548186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.548186] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.548186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.548186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.548186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.548186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.548186] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f already deleted. [ 837.548186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.569268] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.569444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.569496] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.569766] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.569858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.570079] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.570189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.570255] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.570436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.570515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.570601] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be updated. [ 837.575181] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.575181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.575181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.575181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.575181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.591251] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: IN_PROGRESS for 2s [ 837.611438] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.611764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.611764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.612070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.612070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.628236] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: IN_PROGRESS for 2s [ 838.049141] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9db10f55-ced7-42e6-b2f3-a1fde607f58f: rpc.has_security_group_logging(os_id): False [ 838.071653] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.071835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.071875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.072156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.072290] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.073337] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.073337] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.073337] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.073337] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.073337] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.073337] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f is going to be created. [ 838.098096] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9db10f55-ced7-42e6-b2f3-a1fde607f58f], does not exist path=[/infra/domains/default/groups/9db10f55-ced7-42e6-b2f3-a1fde607f58f]."\n}' [ 838.098262] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9db10f55-ced7-42e6-b2f3-a1fde607f58f [ 838.098336] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 838.145181] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.145465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.145465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.146222] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.147187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.147362] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.147496] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.147555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.147808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.147808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.147961] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.148514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.148597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.148752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.148920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.149154] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9db10f55-ced7-42e6-b2f3-a1fde607f58f is going to be created. [ 838.173361] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9db10f55-ced7-42e6-b2f3-a1fde607f58f], does not exist path=[/infra/domains/default/groups/9db10f55-ced7-42e6-b2f3-a1fde607f58f]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9db10f55-ced7-42e6-b2f3-a1fde607f58f [ 838.173510] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9db10f55-ced7-42e6-b2f3-a1fde607f58f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.174056] env[70535]: Traceback (most recent call last): [ 838.174128] env[70535]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 838.174128] env[70535]: return func(*args, **kwargs) [ 838.174128] env[70535]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 838.174128] env[70535]: res.raise_for_status() [ 838.174128] env[70535]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 838.174128] env[70535]: raise HTTPError(http_error_msg, response=self) [ 838.174128] env[70535]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9db10f55-ced7-42e6-b2f3-a1fde607f58f [ 838.174128] env[70535]: During handling of the above exception, another exception occurred: [ 838.174128] env[70535]: Traceback (most recent call last): [ 838.174128] env[70535]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 838.174128] env[70535]: listener.cb(fileno) [ 838.174128] env[70535]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 838.174128] env[70535]: result = function(*args, **kwargs) [ 838.174128] env[70535]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 838.174128] env[70535]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 838.174128] env[70535]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 838.174128] env[70535]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 838.174128] env[70535]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 838.174128] env[70535]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 838.174128] env[70535]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 838.174128] env[70535]: res.raise_for_status() [ 838.174128] env[70535]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 838.174128] env[70535]: raise HTTPError(http_error_msg, response=self) [ 838.174128] env[70535]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9db10f55-ced7-42e6-b2f3-a1fde607f58f [ 838.174128] env[70535]: Removing descriptor: 23 [ 838.212518] env[70535]: INFO networking_nsxv3.common.synchronization [req-cd4bc7d7-aaf9-4771-bdce-e9e5bbc50655 req-9bed6b65-7847-46d6-a264-aa285050dbc3 service nova] Enqueued Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGHEST for action security_group_rules [ 838.212518] env[70535]: INFO networking_nsxv3.common.synchronization [req-cd4bc7d7-aaf9-4771-bdce-e9e5bbc50655 req-9bed6b65-7847-46d6-a264-aa285050dbc3 service nova] Enqueued Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGHEST for action security_group_members [ 838.212738] env[70535]: INFO networking_nsxv3.common.synchronization [req-cd4bc7d7-aaf9-4771-bdce-e9e5bbc50655 req-9bed6b65-7847-46d6-a264-aa285050dbc3 service nova] Enqueued Resource ID: bb949cb2-5601-4623-99f5-30d023ee6b8f with Priority: HIGHEST for action port [ 838.212865] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGHEST for action security_group_rules [ 838.213092] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGHEST for action security_group_members [ 838.213131] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb949cb2-5601-4623-99f5-30d023ee6b8f with Priority: HIGHEST for action port [ 838.216046] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b11bca7-ad54-4a56-a651-3a19b70ab917 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.216046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.216046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.216046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.216046] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b11bca7-ad54-4a56-a651-3a19b70ab917',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.216046] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b11bca7-ad54-4a56-a651-3a19b70ab917 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.216046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.216046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.216046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.216046] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.216046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.216046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.217149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.217149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.217149] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b11bca7-ad54-4a56-a651-3a19b70ab917',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.217478] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb949cb2-5601-4623-99f5-30d023ee6b8f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.217629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb949cb2-5601-4623-99f5-30d023ee6b8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.217660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb949cb2-5601-4623-99f5-30d023ee6b8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.217825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb949cb2-5601-4623-99f5-30d023ee6b8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.217901] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb949cb2-5601-4623-99f5-30d023ee6b8f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.721941] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b11bca7-ad54-4a56-a651-3a19b70ab917',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.724744] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b11bca7-ad54-4a56-a651-3a19b70ab917 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.724744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.724744] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb949cb2-5601-4623-99f5-30d023ee6b8f with status ACTIVE [ 838.724744] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.724744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.724744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.724744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.724744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.724744] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.724744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.724744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.724744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.724744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.725399] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.725399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.725399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.725399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.725399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.725568] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb949cb2-5601-4623-99f5-30d023ee6b8f is going to be updated. [ 838.749412] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.749601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.749664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.749831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.751105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.751105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb949cb2-5601-4623-99f5-30d023ee6b8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.871855] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 838.872392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.886405] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c in Status: SUCCESS [ 838.887690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.887690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.887690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.887690] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.887690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.887690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.887690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.887690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.887690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.888178] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2476f5f-d3ef-49eb-bade-f2adb005ec7c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.228044] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b11bca7-ad54-4a56-a651-3a19b70ab917',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.390059] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.390271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.390271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.390468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.390722] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.390880] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.390980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.391223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.391330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.391409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.391569] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.391660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.391718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.391866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.392030] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.392155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.392259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.392352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.392427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.392511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.392820] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2476f5f-d3ef-49eb-bade-f2adb005ec7c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.609030] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: SUCCESS [ 839.609964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.611712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.611712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.611712] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.612059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.612059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.612149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.612180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.612301] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.612440] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.614401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.618366] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.618952] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.618952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.618952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.618952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.618952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.619395] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.640626] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 839.640885] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b deletion is rescheduled due to dependency. [ 839.641065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.733600] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.734046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.734046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.734046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.734248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.734568] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 is going to be created. [ 839.768399] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.768676] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.768676] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.768818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.768962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.783100] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 in Status: UNINITIALIZED for 2s [ 839.897059] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2476f5f-d3ef-49eb-bade-f2adb005ec7c: rpc.has_security_group_logging(os_id): False [ 839.922762] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.922993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.923066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.923341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.923462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.923780] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.923983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.924116] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.924386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.924485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.925058] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.925058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.925058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.925305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.925305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.925660] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.925765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.925811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.926994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.926994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.926994] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c is going to be created. [ 839.999862] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.000093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.000243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.000389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.000522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.013960] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c in Status: IN_PROGRESS for 2s [ 840.120667] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.120874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.121021] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.290709] env[70535]: INFO networking_nsxv3.common.synchronization [None req-2b310704-8b39-4145-939e-61f258de7042 tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae with Priority: HIGHEST for action security_group_rules [ 840.291265] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae with Priority: HIGHEST for action security_group_rules [ 840.291624] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.291755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.291858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.294893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.294984] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ac4f9b-8f0d-49c2-916e-fc155db340ae',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.409375] env[70535]: INFO networking_nsxv3.common.synchronization [None req-466af0cf-af69-4bf5-8a49-bdef200a6479 tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae with Priority: HIGHEST for action security_group_rules [ 840.413115] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae with Priority: HIGHEST for action security_group_rules [ 840.413115] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.413115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.622830] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.800037] env[70535]: INFO networking_nsxv3.common.synchronization [req-bd72fc12-c553-4b85-bea9-d3717bdbe0e6 req-61e1acca-87df-4d75-93af-7d1e46eeceeb tempest-ImagesOneServerNegativeTestJSON-495716502 tempest-ImagesOneServerNegativeTestJSON-495716502-project-member] Enqueued Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 840.801029] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 840.801429] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.801831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.801831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.801930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.802097] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.802197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.802344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.802501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.802870] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.803114] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.821543] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.821543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.821764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.821821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.822485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.822485] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae already deleted. [ 840.822485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.822742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.822793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.822862] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ac4f9b-8f0d-49c2-916e-fc155db340ae',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.128849] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.128849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.128849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.128849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.128849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.128849] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a is going to be updated. [ 841.159426] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.159426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.159426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.159426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.159894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.171316] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: IN_PROGRESS for 2s [ 841.306058] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.306838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.308847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.308847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.331743] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.332222] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.332492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.332656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.332944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.333140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.333320] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50631980-025e-4f7c-a21a-486351e09d1f is going to be updated. [ 841.348108] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.348108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.348108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.348108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.348108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.348108] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae already deleted. [ 841.348108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.369467] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.369467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.369467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.369467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.369467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.379875] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: IN_PROGRESS for 2s [ 841.413019] env[70535]: INFO networking_nsxv3.common.synchronization [req-ffb4b712-f7df-4cc7-8941-cbab01e3e117 req-28a03342-6239-4261-9851-e99aedbbbfc3 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 841.413298] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 841.413578] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.413712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.413781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.414071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.414329] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.414443] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.414504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.414678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.414775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.414867] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.461193] env[70535]: INFO networking_nsxv3.common.synchronization [req-2002ceb4-ee4c-4080-a063-921a7f62d98c req-7ffdd595-772d-47e5-8280-2e05f26aebdd tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 with Priority: HIGHEST for action security_group_members [ 841.461695] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 with Priority: HIGHEST for action security_group_members [ 841.463833] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.463833] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.463833] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.464121] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.464396] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.464618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.464707] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.464921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.464983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.466714] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48008d9c-bbf6-40a2-bb47-24eddd9f74c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.796840] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 in Status: SUCCESS [ 841.797117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.797696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.797920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.798125] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.798243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.798307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.798458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.798536] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.798624] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.798713] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b11bca7-ad54-4a56-a651-3a19b70ab917',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.874302] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.874302] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-353" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.874302] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-353" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.874302] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-353" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.874302] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.874302] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.874302] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.875130] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.875402] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.875729] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.875951] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.876276] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.876794] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.877463] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.877463] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.877463] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.901261] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.901515] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 841.901725] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.901991] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-353" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.905652] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.905652] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.905652] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.905652] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.905652] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50b6b74d-ee0c-4bf5-b904-3346b7fb4341',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.918969] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.970639] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.970639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.970639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.970639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.994592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.995368] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.997021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.997021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.997021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.997021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.997021] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 is going to be updated. [ 842.029525] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.029701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.029775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.030076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.030405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.032474] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c in Status: SUCCESS [ 842.032538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.041309] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 in Status: IN_PROGRESS for 2s [ 842.302677] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b11bca7-ad54-4a56-a651-3a19b70ab917',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.408334] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.408672] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.408892] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.409497] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.409497] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.409607] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 50b6b74d-ee0c-4bf5-b904-3346b7fb4341 not found, creating... [ 842.409815] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.410081] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.410148] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.410430] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.410485] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.410919] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.410919] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.411329] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.411983] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.412394] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.412769] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 50b6b74d-ee0c-4bf5-b904-3346b7fb4341 is going to be created. [ 842.421751] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.436779] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.437295] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.437295] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.437568] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.437863] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.438192] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.808739] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b11bca7-ad54-4a56-a651-3a19b70ab917: rpc.has_security_group_logging(os_id): False [ 842.832457] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.835481] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.837034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.837034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.837034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.837568] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.837925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.837925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.838054] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.838148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.838273] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 is going to be created. [ 842.921466] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.921466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.921466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.921466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.921929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.924035] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.924514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.924514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.924692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.924895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.924956] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 842.937898] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 in Status: IN_PROGRESS for 2s [ 842.953629] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.954096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.954595] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.954880] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.955104] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.964404] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 842.969728] env[70535]: INFO networking_nsxv3.common.synchronization [req-6e44e2de-1c2d-42b3-947e-fd96e077c2e2 req-c87c50b9-81f4-47f0-9b7c-649d90781f34 tempest-ServerRescueTestJSONUnderV235-1149632473 tempest-ServerRescueTestJSONUnderV235-1149632473-project-member] Enqueued Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_members [ 842.969728] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a with Priority: HIGHEST for action security_group_members [ 842.969728] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.969728] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.182803] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: SUCCESS [ 843.182803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.182803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.183035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.184053] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.184053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.184053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.184053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.184053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.184053] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.362824] env[70535]: INFO networking_nsxv3.common.synchronization [req-ffb4b712-f7df-4cc7-8941-cbab01e3e117 req-33da86bf-cb4f-4511-a4b2-e70466d6cacb service nova] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_rules [ 843.363124] env[70535]: INFO networking_nsxv3.common.synchronization [req-ffb4b712-f7df-4cc7-8941-cbab01e3e117 req-33da86bf-cb4f-4511-a4b2-e70466d6cacb service nova] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 843.363250] env[70535]: INFO networking_nsxv3.common.synchronization [req-ffb4b712-f7df-4cc7-8941-cbab01e3e117 req-33da86bf-cb4f-4511-a4b2-e70466d6cacb service nova] Enqueued Resource ID: 50b6b74d-ee0c-4bf5-b904-3346b7fb4341 with Priority: HIGHEST for action port [ 843.363799] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_rules [ 843.363938] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 843.365850] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50b6b74d-ee0c-4bf5-b904-3346b7fb4341 with Priority: HIGHEST for action port [ 843.366340] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.366340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.366340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.366511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.366555] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.367471] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.367585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.368127] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.368234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.368234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.368406] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.368479] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50b6b74d-ee0c-4bf5-b904-3346b7fb4341',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.391435] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: SUCCESS [ 843.391663] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50631980-025e-4f7c-a21a-486351e09d1f deletion is rescheduled due to dependency. [ 843.391772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.687262] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.689310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.689310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.689310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.710652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.711253] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.711542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.711715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.712064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.712301] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.712512] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a is going to be updated. [ 843.753887] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.753887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.753887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.753887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.753887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.762250] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: IN_PROGRESS for 2s [ 843.838583] env[70535]: INFO networking_nsxv3.common.synchronization [req-976f00dd-b7e0-4f23-aac3-f71d5774543e req-e203a64a-5c58-4a73-ad89-ab23f5e1b3a0 tempest-InstanceActionsNegativeTestJSON-1774558084 tempest-InstanceActionsNegativeTestJSON-1774558084-project-member] Enqueued Resource ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc with Priority: HIGHEST for action security_group_members [ 843.839333] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc with Priority: HIGHEST for action security_group_members [ 843.840777] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.840940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.840998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.841280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.841441] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.841556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.841621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.841747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.841830] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.841925] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704d6b72-3e14-4725-96b9-ddcf6d1bb8bc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.870606] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.870770] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.871417] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50b6b74d-ee0c-4bf5-b904-3346b7fb4341 with status ACTIVE [ 843.871601] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.871705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.871773] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.871977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.872082] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.872277] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.873031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.873031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.873031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.873031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.873031] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.873031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.873031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.873310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.873310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.873310] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50b6b74d-ee0c-4bf5-b904-3346b7fb4341 is going to be updated. [ 843.900266] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.900266] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.900266] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.900266] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.900266] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.900266] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.059125] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 in Status: SUCCESS [ 844.059582] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 deletion is rescheduled due to dependency. [ 844.059582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.317109] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-262 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.317334] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-262" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.317512] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-262" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.318629] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-262" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.318629] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.318629] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.318629] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.320225] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.320225] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.320225] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.320225] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.320225] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.320225] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.320225] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.320225] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.320225] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.347689] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.347689] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 844.347689] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.347689] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-262" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.348164] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.348164] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.348260] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.350893] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.350893] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.351397] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.351610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.351728] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.352046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.352206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.352492] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.353896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.353896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.353896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.353896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.353896] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc already deleted. [ 844.353896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.854776] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.855195] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.855364] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.855704] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.855982] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.856251] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c not found, creating... [ 844.856576] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.856777] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.856907] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.857208] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.857397] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.857726] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.857919] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.858071] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.858326] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.858481] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.858674] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c is going to be created. [ 844.883775] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.884133] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.884402] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.884804] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.885136] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.885404] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.962160] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 in Status: SUCCESS [ 844.962445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.975025] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 844.975265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.975423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.975653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.975847] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.975966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.976044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.976205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.976294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.976438] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.478278] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.742772] env[70535]: INFO networking_nsxv3.common.synchronization [req-976f00dd-b7e0-4f23-aac3-f71d5774543e req-0bbdef92-c563-4b46-9da2-69f6b8efe128 service nova] Enqueued Resource ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc with Priority: HIGHEST for action security_group_rules [ 845.742772] env[70535]: INFO networking_nsxv3.common.synchronization [req-976f00dd-b7e0-4f23-aac3-f71d5774543e req-0bbdef92-c563-4b46-9da2-69f6b8efe128 service nova] Enqueued Resource ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc with Priority: HIGHEST for action security_group_members [ 845.742919] env[70535]: INFO networking_nsxv3.common.synchronization [req-976f00dd-b7e0-4f23-aac3-f71d5774543e req-0bbdef92-c563-4b46-9da2-69f6b8efe128 service nova] Enqueued Resource ID: a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c with Priority: HIGHEST for action port [ 845.744313] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc with Priority: HIGHEST for action security_group_rules [ 845.744313] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc with Priority: HIGHEST for action security_group_members [ 845.744313] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c with Priority: HIGHEST for action port [ 845.744313] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.745497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.745596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.745945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.746081] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('704d6b72-3e14-4725-96b9-ddcf6d1bb8bc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.748150] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.748309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.748397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.748656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.748866] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.748976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.749243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.749243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.749319] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.749418] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704d6b72-3e14-4725-96b9-ddcf6d1bb8bc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.753258] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.753404] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.753502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.753660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.753733] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.773351] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: SUCCESS [ 845.773547] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a deletion is rescheduled due to dependency. [ 845.773662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.773827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.774060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.774269] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.774412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.774509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.774682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.774782] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.774936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.775040] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ea29cae-e57a-45bc-881e-d2a221f2801a taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.775130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.775189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.775346] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.775520] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.775639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.775701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.775840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.775916] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.775996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.776095] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.777461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.777666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.777816] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.777921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.777985] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.778138] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.778217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.778322] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.983862] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.259241] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('704d6b72-3e14-4725-96b9-ddcf6d1bb8bc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.260357] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.260483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.260566] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c with status ACTIVE [ 846.260723] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.260825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.260890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.261105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.261193] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.261365] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.261462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.261515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.261678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.261744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.261893] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.261978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.262071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.262212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.262283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.262366] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c is going to be updated. [ 846.279556] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ea29cae-e57a-45bc-881e-d2a221f2801a: rpc.has_security_group_logging(os_id): False [ 846.280816] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.281071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.281071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.281433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.281433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.281668] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.281668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.281921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.281921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.281921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.282091] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a is going to be updated. [ 846.292718] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.294938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.294938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.294938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.294938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.294938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8d93ccd-68e7-4cb7-9e2b-9b720ef5e08c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.301635] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.301787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.304040] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.304361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.304511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.304671] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.304782] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.304838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.305009] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.305090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.305299] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.305427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.305547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.305664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.305749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.306139] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.306238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.306367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.306476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.306556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.306647] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a is going to be updated. [ 846.320345] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.320345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.320345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.320705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.320705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.342357] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: IN_PROGRESS for 2s [ 846.421641] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.424023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.424023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.424023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.424023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.451672] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: IN_PROGRESS for 2s [ 846.486022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.486022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.486022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.486906] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.486906] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.486906] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 846.554561] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.554561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.554561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.554561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.554561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.572472] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 846.636974] env[70535]: INFO networking_nsxv3.common.synchronization [req-bb954eeb-85e3-42c2-84ea-4d2ffaaf25f5 req-b13f0d72-a3c0-4124-84a3-d5a443871482 tempest-ServerGroupTestJSON-1023642755 tempest-ServerGroupTestJSON-1023642755-project-member] Enqueued Resource ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c with Priority: HIGHEST for action security_group_members [ 846.637578] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c with Priority: HIGHEST for action security_group_members [ 846.639848] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.640063] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.640135] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.640442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.640572] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.640667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.640742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.640892] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.641018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.641993] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2476f5f-d3ef-49eb-bade-f2adb005ec7c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.764940] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('704d6b72-3e14-4725-96b9-ddcf6d1bb8bc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.144800] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.144992] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.145114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.145493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.145609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.145873] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.146016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.146168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.146332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.146429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.146545] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c is going to be updated. [ 847.221345] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.221959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.226070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.226463] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.226737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.240667] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c in Status: IN_PROGRESS for 2s [ 847.259790] env[70535]: INFO networking_nsxv3.common.synchronization [req-e501376b-35de-44cb-8127-7007b3b9af65 req-b4bedae7-c309-4453-a90f-dc4b74979688 tempest-ServerDiskConfigTestJSON-1021082095 tempest-ServerDiskConfigTestJSON-1021082095-project-member] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 847.260503] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 847.260849] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.261674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.261674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.261674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.261674] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.261674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.261917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.261917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.262036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.262036] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.268826] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.268826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.268826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.269122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.269122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.269184] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc is going to be created. [ 847.300773] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.300999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.301155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.301513] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.301765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.317244] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc in Status: UNINITIALIZED for 2s [ 847.764269] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.764580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.764647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.764903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.799377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.799697] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.799891] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.799891] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.800153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.800225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.800297] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 847.843244] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.843244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.843244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.843244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.843244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.855103] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 847.858403] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.858604] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.859083] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.859634] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.859634] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.859634] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.860025] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.860025] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.860257] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.860579] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.860670] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.860782] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.860893] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.861010] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.861140] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.861278] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.890846] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.891054] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 847.891628] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.891628] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.891949] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-1024a21c-3bc6-4fc1-b2fc-77760328ea6f taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.891949] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-1024a21c-3bc6-4fc1-b2fc-77760328ea6f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.891949] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-1024a21c-3bc6-4fc1-b2fc-77760328ea6f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.892359] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-1024a21c-3bc6-4fc1-b2fc-77760328ea6f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.892557] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1024a21c-3bc6-4fc1-b2fc-77760328ea6f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.354729] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: SUCCESS [ 848.355055] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a deletion is rescheduled due to dependency. [ 848.355332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.396034] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.396034] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.396288] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.396573] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.396811] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.397078] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 1024a21c-3bc6-4fc1-b2fc-77760328ea6f not found, creating... [ 848.397501] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.397769] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.397965] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.398983] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.399360] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.399875] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.400144] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.400530] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.400832] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.401112] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.401338] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 1024a21c-3bc6-4fc1-b2fc-77760328ea6f is going to be created. [ 848.442238] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.442556] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.442875] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.443225] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.443547] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.443899] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-1024a21c-3bc6-4fc1-b2fc-77760328ea6f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.471435] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a in Status: SUCCESS [ 848.471804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.471940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.472194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.472291] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ea29cae-e57a-45bc-881e-d2a221f2801a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.583966] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 848.584692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.585037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.585480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.586029] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.587041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.587041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.587041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.587431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.587567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.587757] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.995313] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.995695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.995695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.995805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.999129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.999129] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ea29cae-e57a-45bc-881e-d2a221f2801a is going to be deleted. [ 849.066464] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.066683] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.067245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.067682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.067886] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.068174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ea29cae-e57a-45bc-881e-d2a221f2801a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.091513] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.092057] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.092229] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.093491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.093702] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.093862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.093897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.094117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.094169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.094263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.094462] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.094545] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.094639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.094774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.094914] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.095019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.095100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.095217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.095299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.095387] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.095484] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.227405] env[70535]: INFO networking_nsxv3.common.synchronization [req-e501376b-35de-44cb-8127-7007b3b9af65 req-704e2447-59a6-4d6a-a995-2900015346f5 service nova] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_rules [ 849.227596] env[70535]: INFO networking_nsxv3.common.synchronization [req-e501376b-35de-44cb-8127-7007b3b9af65 req-704e2447-59a6-4d6a-a995-2900015346f5 service nova] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 849.227740] env[70535]: INFO networking_nsxv3.common.synchronization [req-e501376b-35de-44cb-8127-7007b3b9af65 req-704e2447-59a6-4d6a-a995-2900015346f5 service nova] Enqueued Resource ID: 1024a21c-3bc6-4fc1-b2fc-77760328ea6f with Priority: HIGHEST for action port [ 849.227986] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_rules [ 849.228132] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 849.228228] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1024a21c-3bc6-4fc1-b2fc-77760328ea6f with Priority: HIGHEST for action port [ 849.228868] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.229928] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.230886] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.231188] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.231317] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.233445] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.233445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.233445] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-1024a21c-3bc6-4fc1-b2fc-77760328ea6f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.233445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1024a21c-3bc6-4fc1-b2fc-77760328ea6f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.233445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1024a21c-3bc6-4fc1-b2fc-77760328ea6f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.233445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1024a21c-3bc6-4fc1-b2fc-77760328ea6f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.233445] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1024a21c-3bc6-4fc1-b2fc-77760328ea6f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.255367] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c in Status: SUCCESS [ 849.255367] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c deletion is rescheduled due to dependency. [ 849.255367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.330040] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc in Status: SUCCESS [ 849.330221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.331169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.331169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.331169] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.331169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.331491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.331565] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.331659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.331809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.331922] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('704d6b72-3e14-4725-96b9-ddcf6d1bb8bc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.598679] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2: rpc.has_security_group_logging(os_id): False [ 849.630469] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.630469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.630469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.631612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.664901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.665173] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.665411] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.665557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.665835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.665983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.666911] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.666911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.666911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.666911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.667131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.667364] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.667532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.667630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.667893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.668044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.668185] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 849.735676] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.735978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.736415] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1024a21c-3bc6-4fc1-b2fc-77760328ea6f with status ACTIVE [ 849.736488] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.736571] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.736636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.737033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.737103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.737303] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.737422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.737488] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.737852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.737852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.737975] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.738052] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.738107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.738239] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.738312] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.738397] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1024a21c-3bc6-4fc1-b2fc-77760328ea6f is going to be updated. [ 849.783484] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.785276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.785276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.785641] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.786013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.787721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1024a21c-3bc6-4fc1-b2fc-77760328ea6f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.791684] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.794179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.795071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.795136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.795414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.825471] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 849.836304] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.836657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.836746] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.837028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.837294] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.837495] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.837616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.837895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.838308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.838308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.838524] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.838690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.838803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.839668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.839772] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.840030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.840203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.840579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.840770] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.840965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.841193] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('704d6b72-3e14-4725-96b9-ddcf6d1bb8bc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.867979] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 849.867979] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 deletion is rescheduled due to dependency. [ 849.867979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.867979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.868449] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.869610] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.869610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.869610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.869610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.869610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.869610] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.346319] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc: rpc.has_security_group_logging(os_id): False [ 850.366549] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.367092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.367241] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.367518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.367661] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.367960] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.368255] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.368255] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.368466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.368582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.368841] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.369601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.369644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.369828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.369912] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.370121] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.370237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.370311] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.370448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.370540] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.370624] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc is going to be created. [ 850.372335] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.448416] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.448597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.448682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.448912] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.449219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.464689] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc in Status: IN_PROGRESS for 2s [ 850.522676] env[70535]: INFO networking_nsxv3.common.synchronization [req-595d7838-894f-40d1-ae4b-bb7a424f4476 req-743b8a7c-d449-4b2c-97ca-327c4484ff5b tempest-ServersTestJSON-1256413413 tempest-ServersTestJSON-1256413413-project-member] Enqueued Resource ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 with Priority: HIGHEST for action security_group_members [ 850.523314] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 with Priority: HIGHEST for action security_group_members [ 850.525254] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.525254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.525254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.525254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.525254] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.525254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.525254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.525254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.525254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.525254] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46eec3ed-88a9-4ea1-a649-2f92efa91eb5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.876337] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.027543] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.027799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.027799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.028014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.051014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.051303] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.051410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.051535] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.051827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.051827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.051953] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 is going to be updated. [ 851.087078] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.087078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.087078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.087078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.087078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.100693] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 in Status: IN_PROGRESS for 2s [ 851.378877] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.379334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.379334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.379425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.379497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.379630] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 851.411354] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.411514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.411599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.411773] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.411914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.422663] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 851.843801] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 851.844059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.104102] env[70535]: INFO networking_nsxv3.common.synchronization [req-aab064f9-0c34-4409-8689-d8af68e5688b req-cce5b087-bc52-4102-a186-54177c5292dc tempest-ServerMetadataTestJSON-1307689100 tempest-ServerMetadataTestJSON-1307689100-project-member] Enqueued Resource ID: cf801cfb-8004-42d6-a945-4d3f88953372 with Priority: HIGHEST for action security_group_members [ 852.104823] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf801cfb-8004-42d6-a945-4d3f88953372 with Priority: HIGHEST for action security_group_members [ 852.105136] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf801cfb-8004-42d6-a945-4d3f88953372 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.105322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.105418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.106280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.106581] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.106798] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.106916] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.107383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.107517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.107781] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf801cfb-8004-42d6-a945-4d3f88953372',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.484410] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc in Status: SUCCESS [ 852.484410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.610391] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.611076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.611186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.611390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.611480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.611698] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.611808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.611858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.612807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.612807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.612807] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf801cfb-8004-42d6-a945-4d3f88953372 already deleted. [ 852.612807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.637161] env[70535]: INFO networking_nsxv3.common.synchronization [req-929aad13-587e-4000-847f-f5b0069b95f7 req-b6c6f3e2-ec6a-4142-962a-07ce63b4b14d tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 852.637161] env[70535]: INFO networking_nsxv3.common.synchronization [req-929aad13-587e-4000-847f-f5b0069b95f7 req-b6c6f3e2-ec6a-4142-962a-07ce63b4b14d tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGHEST for action security_group_members [ 852.637161] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 852.638137] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGHEST for action security_group_members [ 852.638834] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.639934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.640396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.640396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.640902] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.640902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.640902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.641271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.641271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.641750] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.646228] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-59140a91-434d-4615-899a-f10ff35ce431 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.646228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.646228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.646228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.646228] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.646228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.646228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.646228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.646228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.646228] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.689454] env[70535]: INFO networking_nsxv3.common.synchronization [req-929aad13-587e-4000-847f-f5b0069b95f7 req-b6c6f3e2-ec6a-4142-962a-07ce63b4b14d tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGHEST for action security_group_rules [ 852.689704] env[70535]: INFO networking_nsxv3.common.synchronization [req-929aad13-587e-4000-847f-f5b0069b95f7 req-b6c6f3e2-ec6a-4142-962a-07ce63b4b14d tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGHEST for action security_group_members [ 852.689918] env[70535]: INFO networking_nsxv3.common.synchronization [req-929aad13-587e-4000-847f-f5b0069b95f7 req-b6c6f3e2-ec6a-4142-962a-07ce63b4b14d tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_rules [ 852.690099] env[70535]: INFO networking_nsxv3.common.synchronization [req-929aad13-587e-4000-847f-f5b0069b95f7 req-b6c6f3e2-ec6a-4142-962a-07ce63b4b14d tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 852.690242] env[70535]: INFO networking_nsxv3.common.synchronization [req-929aad13-587e-4000-847f-f5b0069b95f7 req-b6c6f3e2-ec6a-4142-962a-07ce63b4b14d tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 50b6b74d-ee0c-4bf5-b904-3346b7fb4341 with Priority: HIGHEST for action port [ 852.690818] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGHEST for action security_group_rules [ 852.690971] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_rules [ 852.691464] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50b6b74d-ee0c-4bf5-b904-3346b7fb4341 with Priority: HIGHEST for action port [ 852.691464] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGHEST for action security_group_members [ 852.692093] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 852.692093] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59140a91-434d-4615-899a-f10ff35ce431 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.692093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.692093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.692426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.692426] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.694012] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.694097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.694164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.694328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.694447] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.700148] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.700148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.700148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.700148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.700148] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50b6b74d-ee0c-4bf5-b904-3346b7fb4341',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.700632] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-59140a91-434d-4615-899a-f10ff35ce431 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.700745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.700853] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.700927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.969814] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-771 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.970158] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-771" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.970231] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-771" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.970707] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-771" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.971017] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.971378] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.971531] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.975622] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.975622] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.975622] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.975791] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.975829] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.976320] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.976320] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.976320] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.976320] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.999947] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.000198] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 853.000313] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.000549] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-771" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.000952] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-86ee7732-1802-4e72-b364-0bf3ee389da7 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.001169] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-86ee7732-1802-4e72-b364-0bf3ee389da7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.001290] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-86ee7732-1802-4e72-b364-0bf3ee389da7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.001623] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-86ee7732-1802-4e72-b364-0bf3ee389da7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.001770] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ee7732-1802-4e72-b364-0bf3ee389da7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.115136] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 in Status: SUCCESS [ 853.115332] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 deletion is rescheduled due to dependency. [ 853.115477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.146684] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.147643] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.202470] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50b6b74d-ee0c-4bf5-b904-3346b7fb4341 with status ACTIVE [ 853.202720] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.202863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.202924] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.203177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.203268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.203462] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.203576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.203780] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.203780] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.204109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.204324] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.204462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.204555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.204771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.204875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.205014] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50b6b74d-ee0c-4bf5-b904-3346b7fb4341 is going to be updated. [ 853.208687] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-59140a91-434d-4615-899a-f10ff35ce431 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.208837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.209141] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.209236] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.235552] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.236936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.236936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.237176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.237320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.237482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.439795] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 853.439795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.439795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.439795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.439795] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.439795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.439795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.439795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.439795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.439795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.439795] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.503992] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.504418] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.504418] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.504742] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.505058] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.505153] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 86ee7732-1802-4e72-b364-0bf3ee389da7 not found, creating... [ 853.505471] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.505660] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.505781] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.506060] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.506304] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.506622] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.506939] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.507115] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.507353] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.507496] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.507641] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 86ee7732-1802-4e72-b364-0bf3ee389da7 is going to be created. [ 853.539029] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.539029] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.539029] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.539029] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.539029] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.539029] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-86ee7732-1802-4e72-b364-0bf3ee389da7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.650064] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.652890] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.942692] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.942792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.942792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.943048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.943239] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.943345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.943406] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.943576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.943666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.943758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.943905] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.943999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.944074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.944216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.944358] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.944522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.944608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.944697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.944770] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.944848] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.944940] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.153333] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.157420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.157420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.157420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.157420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.157420] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 854.157420] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.157420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.157420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.157420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.157420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.157420] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59140a91-434d-4615-899a-f10ff35ce431 is going to be created. [ 854.186550] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.186703] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.186779] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.187017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.187187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.198832] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.198981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.199063] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.199282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.199426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.205401] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59140a91-434d-4615-899a-f10ff35ce431 in Status: UNINITIALIZED for 2s [ 854.213944] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 854.358726] env[70535]: INFO networking_nsxv3.common.synchronization [req-aab064f9-0c34-4409-8689-d8af68e5688b req-a9280f55-be89-48ee-b4a6-85b298535d77 service nova] Enqueued Resource ID: cf801cfb-8004-42d6-a945-4d3f88953372 with Priority: HIGHEST for action security_group_rules [ 854.359078] env[70535]: INFO networking_nsxv3.common.synchronization [req-aab064f9-0c34-4409-8689-d8af68e5688b req-a9280f55-be89-48ee-b4a6-85b298535d77 service nova] Enqueued Resource ID: cf801cfb-8004-42d6-a945-4d3f88953372 with Priority: HIGHEST for action security_group_members [ 854.359306] env[70535]: INFO networking_nsxv3.common.synchronization [req-aab064f9-0c34-4409-8689-d8af68e5688b req-a9280f55-be89-48ee-b4a6-85b298535d77 service nova] Enqueued Resource ID: 86ee7732-1802-4e72-b364-0bf3ee389da7 with Priority: HIGHEST for action port [ 854.360686] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf801cfb-8004-42d6-a945-4d3f88953372 with Priority: HIGHEST for action security_group_rules [ 854.360905] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf801cfb-8004-42d6-a945-4d3f88953372 with Priority: HIGHEST for action security_group_members [ 854.361072] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ee7732-1802-4e72-b364-0bf3ee389da7 with Priority: HIGHEST for action port [ 854.361414] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf801cfb-8004-42d6-a945-4d3f88953372 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.361585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.361679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.361971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.362102] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf801cfb-8004-42d6-a945-4d3f88953372',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.363088] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf801cfb-8004-42d6-a945-4d3f88953372 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.363450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.363556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.363867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.364286] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.364782] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.365119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.365119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.365211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.365332] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf801cfb-8004-42d6-a945-4d3f88953372',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.366174] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-86ee7732-1802-4e72-b364-0bf3ee389da7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.366332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86ee7732-1802-4e72-b364-0bf3ee389da7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.366404] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86ee7732-1802-4e72-b364-0bf3ee389da7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.366563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86ee7732-1802-4e72-b364-0bf3ee389da7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.366642] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ee7732-1802-4e72-b364-0bf3ee389da7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.447467] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for acf72aac-3e82-4909-b3c4-dccd81be0846: rpc.has_security_group_logging(os_id): False [ 854.470049] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.470049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.470049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.470049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.470049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.470049] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.470049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.470049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.470049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.470049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.470049] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.470049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.470049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.470049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.470049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.470713] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.470713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.470713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.470713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.470713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.470713] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 854.531717] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.531717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.531717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.533254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.533254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.546559] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 854.868955] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf801cfb-8004-42d6-a945-4d3f88953372 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.868955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.869139] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf801cfb-8004-42d6-a945-4d3f88953372',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.870091] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86ee7732-1802-4e72-b364-0bf3ee389da7 with status ACTIVE [ 854.871413] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.871413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.871413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.871413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.871413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.871413] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.871413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.871413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.871413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.871413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.871983] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.871983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.871983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.871983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.872138] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.872138] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86ee7732-1802-4e72-b364-0bf3ee389da7 is going to be updated. [ 854.899072] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.899235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.899307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.899569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.899712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.899879] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86ee7732-1802-4e72-b364-0bf3ee389da7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.374403] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf801cfb-8004-42d6-a945-4d3f88953372',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.876562] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.879357] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.879357] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.879357] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.879357] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.879357] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf801cfb-8004-42d6-a945-4d3f88953372 is going to be created. [ 855.906162] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.906162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.906162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.906162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.906162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.914858] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf801cfb-8004-42d6-a945-4d3f88953372 in Status: UNINITIALIZED for 2s [ 856.217133] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59140a91-434d-4615-899a-f10ff35ce431 in Status: SUCCESS [ 856.217508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.217796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.218120] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.218519] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.220033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.220033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.220033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.220033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.220033] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.223934] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 856.224297] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.224888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.225262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.225864] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.227311] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.227311] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.227311] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.227311] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.227311] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.576910] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 856.577677] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.722495] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.729607] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.225983] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.233533] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.733379] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.733379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.733379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.733379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.733379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.733379] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59140a91-434d-4615-899a-f10ff35ce431 is going to be updated. [ 857.739013] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.739013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.739013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.739234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.739484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.739484] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 857.774299] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.774477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.776112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.776112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.776112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.776840] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.776971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.777322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.777322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.777322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.790342] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59140a91-434d-4615-899a-f10ff35ce431 in Status: IN_PROGRESS for 2s [ 857.790543] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 857.926668] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf801cfb-8004-42d6-a945-4d3f88953372 in Status: SUCCESS [ 857.926834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.927109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.927348] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.927564] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.927696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.927789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.928476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.928476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.928476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.928476] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf801cfb-8004-42d6-a945-4d3f88953372',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.128531] env[70535]: INFO networking_nsxv3.common.synchronization [req-8086699a-daf5-45c9-8fe2-562b762775aa req-d5295b93-1233-471f-96cc-6c158a5f5d53 tempest-ServersTestFqdnHostnames-408043169 tempest-ServersTestFqdnHostnames-408043169-project-member] Enqueued Resource ID: 89135034-9b45-4344-b065-0229db08f4f9 with Priority: HIGHEST for action security_group_members [ 858.129321] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89135034-9b45-4344-b065-0229db08f4f9 with Priority: HIGHEST for action security_group_members [ 858.129810] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-89135034-9b45-4344-b065-0229db08f4f9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.130119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.130511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.130996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.131300] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.131688] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.131846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.134021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.134021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.134021] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89135034-9b45-4344-b065-0229db08f4f9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.432601] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf801cfb-8004-42d6-a945-4d3f88953372 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.433091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.433091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.433299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.433625] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.433759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.433856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.434137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.434344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.434442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.434752] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf801cfb-8004-42d6-a945-4d3f88953372 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.434903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.434950] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.436295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.437960] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.437960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.437960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.437960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.437960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.437960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.437960] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf801cfb-8004-42d6-a945-4d3f88953372',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.444374] env[70535]: INFO networking_nsxv3.common.synchronization [None req-10aedc1c-04dc-401a-b858-7bbf40d9e22c None None] Enqueued Resource ID: e3c08882-b3cb-458e-a8fe-e8febffe781b with Priority: HIGHEST for action port [ 858.444693] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3c08882-b3cb-458e-a8fe-e8febffe781b with Priority: HIGHEST for action port [ 858.445412] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3c08882-b3cb-458e-a8fe-e8febffe781b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.445412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3c08882-b3cb-458e-a8fe-e8febffe781b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.445691] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3c08882-b3cb-458e-a8fe-e8febffe781b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.445841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3c08882-b3cb-458e-a8fe-e8febffe781b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.445841] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3c08882-b3cb-458e-a8fe-e8febffe781b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.612019] env[70535]: INFO networking_nsxv3.common.synchronization [req-8142c298-3a55-42fb-b109-bec46e318996 req-1ec5c7fe-fcaa-4c89-acb9-8725c1331b06 tempest-InstanceActionsNegativeTestJSON-1774558084 tempest-InstanceActionsNegativeTestJSON-1774558084-project-member] Enqueued Resource ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc with Priority: HIGHEST for action security_group_members [ 858.612581] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc with Priority: HIGHEST for action security_group_members [ 858.612880] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.612996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.613073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.613268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.613419] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.613515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.613573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.613713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.613796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.613889] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704d6b72-3e14-4725-96b9-ddcf6d1bb8bc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.638975] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.638975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.638975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.638975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.666109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.666341] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.666561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.666561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.666751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.666892] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.666892] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89135034-9b45-4344-b065-0229db08f4f9 is going to be updated. [ 858.702675] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.702829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.702901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.703211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.703428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.718649] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89135034-9b45-4344-b065-0229db08f4f9 in Status: IN_PROGRESS for 2s [ 858.943410] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf801cfb-8004-42d6-a945-4d3f88953372: rpc.has_security_group_logging(os_id): False [ 858.953413] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3c08882-b3cb-458e-a8fe-e8febffe781b [ 858.954216] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.954216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.954216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.954216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.954516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.954516] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3c08882-b3cb-458e-a8fe-e8febffe781b already deleted. [ 858.954606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3c08882-b3cb-458e-a8fe-e8febffe781b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.972267] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.972267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.972267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.972267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.972267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.972267] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.972267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.972267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.972267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.972267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.972267] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.972267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.972267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.972267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.972267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.972913] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.972913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.972913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.972913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.972913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.972913] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf801cfb-8004-42d6-a945-4d3f88953372 is going to be created. [ 859.036773] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.036955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.037056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.037297] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.037525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.053473] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf801cfb-8004-42d6-a945-4d3f88953372 in Status: IN_PROGRESS for 2s [ 859.123459] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.123459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.123673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.123898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.123898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.124051] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.124151] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.124215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.124374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.124454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.124636] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc is going to be updated. [ 859.171361] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.171361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.171361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.171361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.171361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.183306] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc in Status: IN_PROGRESS for 2s [ 859.802193] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 859.802742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.803738] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59140a91-434d-4615-899a-f10ff35ce431 in Status: SUCCESS [ 859.804112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.804530] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.804789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.805037] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.805223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.805318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.805806] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.806155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.806389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.806517] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.807668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.807909] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.808347] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.808647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.808694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.809248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.809248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.809379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.809442] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.017839] env[70535]: INFO networking_nsxv3.common.synchronization [req-dfbd97b0-70e1-4b40-bc10-b3a41ce6eb9c req-503f112a-3b88-4289-9c94-c2ba895a45f8 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 with Priority: HIGHEST for action security_group_members [ 860.018031] env[70535]: INFO networking_nsxv3.common.synchronization [req-dfbd97b0-70e1-4b40-bc10-b3a41ce6eb9c req-503f112a-3b88-4289-9c94-c2ba895a45f8 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGHEST for action security_group_members [ 860.018170] env[70535]: INFO networking_nsxv3.common.synchronization [req-dfbd97b0-70e1-4b40-bc10-b3a41ce6eb9c req-503f112a-3b88-4289-9c94-c2ba895a45f8 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 860.018755] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 with Priority: HIGHEST for action security_group_members [ 860.018897] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGHEST for action security_group_members [ 860.018996] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 860.020285] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-415c6b8e-c0b6-428b-ad08-e66eeae0f267 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.020285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.020285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.020285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.022140] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.022297] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.022408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.022596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.022751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.022785] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415c6b8e-c0b6-428b-ad08-e66eeae0f267',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.023655] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-59140a91-434d-4615-899a-f10ff35ce431 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.023756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.023828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.023990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.024177] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.024282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.024346] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.024534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.024597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.024689] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.025487] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.025610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.025678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.025932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.025998] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.027156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.027156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.027156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.027360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.027360] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.067405] env[70535]: INFO networking_nsxv3.common.synchronization [req-dfbd97b0-70e1-4b40-bc10-b3a41ce6eb9c req-503f112a-3b88-4289-9c94-c2ba895a45f8 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 with Priority: HIGHEST for action security_group_rules [ 860.067686] env[70535]: INFO networking_nsxv3.common.synchronization [req-dfbd97b0-70e1-4b40-bc10-b3a41ce6eb9c req-503f112a-3b88-4289-9c94-c2ba895a45f8 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 with Priority: HIGHEST for action security_group_members [ 860.067775] env[70535]: INFO networking_nsxv3.common.synchronization [req-dfbd97b0-70e1-4b40-bc10-b3a41ce6eb9c req-503f112a-3b88-4289-9c94-c2ba895a45f8 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGHEST for action security_group_rules [ 860.067844] env[70535]: INFO networking_nsxv3.common.synchronization [req-dfbd97b0-70e1-4b40-bc10-b3a41ce6eb9c req-503f112a-3b88-4289-9c94-c2ba895a45f8 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGHEST for action security_group_members [ 860.067956] env[70535]: INFO networking_nsxv3.common.synchronization [req-dfbd97b0-70e1-4b40-bc10-b3a41ce6eb9c req-503f112a-3b88-4289-9c94-c2ba895a45f8 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_rules [ 860.068098] env[70535]: INFO networking_nsxv3.common.synchronization [req-dfbd97b0-70e1-4b40-bc10-b3a41ce6eb9c req-503f112a-3b88-4289-9c94-c2ba895a45f8 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 860.068541] env[70535]: INFO networking_nsxv3.common.synchronization [req-dfbd97b0-70e1-4b40-bc10-b3a41ce6eb9c req-503f112a-3b88-4289-9c94-c2ba895a45f8 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 50b6b74d-ee0c-4bf5-b904-3346b7fb4341 with Priority: HIGHEST for action port [ 860.068990] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 with Priority: HIGHEST for action security_group_rules [ 860.069250] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGHEST for action security_group_rules [ 860.069407] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 860.069545] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50b6b74d-ee0c-4bf5-b904-3346b7fb4341 with Priority: HIGHEST for action port [ 860.069755] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_rules [ 860.069755] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 with Priority: HIGHEST for action security_group_members [ 860.069877] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGHEST for action security_group_members [ 860.070196] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-415c6b8e-c0b6-428b-ad08-e66eeae0f267 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.070560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.070560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.070836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.070931] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('415c6b8e-c0b6-428b-ad08-e66eeae0f267',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.072076] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59140a91-434d-4615-899a-f10ff35ce431 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.072136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.072347] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.072469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.072687] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.072774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.072843] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.073487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.073487] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50b6b74d-ee0c-4bf5-b904-3346b7fb4341',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.074019] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.074207] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.074355] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-415c6b8e-c0b6-428b-ad08-e66eeae0f267 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.074468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.074649] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-59140a91-434d-4615-899a-f10ff35ce431 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.074736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.311678] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.311869] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.313415] env[70535]: INFO networking_nsxv3.common.synchronization [None req-6696b0e0-5f6d-4206-b42d-c54f94b57eae tempest-ServersTestManualDisk-419272698 tempest-ServersTestManualDisk-419272698-project-member] Enqueued Resource ID: f932dfa4-49e7-4477-968f-48bf223104fa with Priority: HIGHEST for action security_group_rules [ 860.314980] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.316128] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f932dfa4-49e7-4477-968f-48bf223104fa with Priority: HIGHEST for action security_group_rules [ 860.316724] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f932dfa4-49e7-4477-968f-48bf223104fa taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.316886] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.316964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.317263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.317385] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f932dfa4-49e7-4477-968f-48bf223104fa',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.446407] env[70535]: INFO networking_nsxv3.common.synchronization [None req-82aa598f-06df-48f4-b375-5622a3168123 tempest-ServersTestManualDisk-419272698 tempest-ServersTestManualDisk-419272698-project-member] Enqueued Resource ID: f932dfa4-49e7-4477-968f-48bf223104fa with Priority: HIGHEST for action security_group_rules [ 860.446833] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f932dfa4-49e7-4477-968f-48bf223104fa with Priority: HIGHEST for action security_group_rules [ 860.448924] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f932dfa4-49e7-4477-968f-48bf223104fa taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.449445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.471889] env[70535]: INFO networking_nsxv3.common.synchronization [None req-cc9c6ff4-46fd-4d1a-82a1-c9d0060d91bf None None] Enqueued Resource ID: 620b0c3f-d548-421f-8e7c-5eb745833eef with Priority: HIGHEST for action port [ 860.472121] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 620b0c3f-d548-421f-8e7c-5eb745833eef with Priority: HIGHEST for action port [ 860.472649] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-620b0c3f-d548-421f-8e7c-5eb745833eef taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.472649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-620b0c3f-d548-421f-8e7c-5eb745833eef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.472649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-620b0c3f-d548-421f-8e7c-5eb745833eef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.473313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-620b0c3f-d548-421f-8e7c-5eb745833eef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.473313] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('620b0c3f-d548-421f-8e7c-5eb745833eef',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.529540] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('415c6b8e-c0b6-428b-ad08-e66eeae0f267',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.533823] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.533823] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.575854] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-415c6b8e-c0b6-428b-ad08-e66eeae0f267 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.575854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.580389] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50b6b74d-ee0c-4bf5-b904-3346b7fb4341 with status ACTIVE [ 860.580648] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.580756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.580830] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.581947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.581947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.581947] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.581947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.581947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.581947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.581947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.582722] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.582722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.582722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.582722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.582896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.583594] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50b6b74d-ee0c-4bf5-b904-3346b7fb4341 is going to be updated. [ 860.627574] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.629373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.629373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.629373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.629373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.629373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50b6b74d-ee0c-4bf5-b904-3346b7fb4341" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.729968] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89135034-9b45-4344-b065-0229db08f4f9 in Status: SUCCESS [ 860.729968] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89135034-9b45-4344-b065-0229db08f4f9 deletion is rescheduled due to dependency. [ 860.729968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.819454] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59140a91-434d-4615-899a-f10ff35ce431: rpc.has_security_group_logging(os_id): False [ 860.845540] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.846056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.846177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.846479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.846608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.846747] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f932dfa4-49e7-4477-968f-48bf223104fa already deleted. [ 860.846877] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.848387] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.848911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.849085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.849503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.849689] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.850083] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.850289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.850431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.850735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.850924] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.851109] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59140a91-434d-4615-899a-f10ff35ce431 is going to be created. [ 860.852694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.853012] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.853188] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f932dfa4-49e7-4477-968f-48bf223104fa',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.913038] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.913038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.913038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.913038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.913038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.924418] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59140a91-434d-4615-899a-f10ff35ce431 in Status: IN_PROGRESS for 2s [ 860.976051] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 620b0c3f-d548-421f-8e7c-5eb745833eef [ 860.976403] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.976713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.976713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.977090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.977162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.977257] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:620b0c3f-d548-421f-8e7c-5eb745833eef already deleted. [ 860.977341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-620b0c3f-d548-421f-8e7c-5eb745833eef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.034999] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.036250] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('415c6b8e-c0b6-428b-ad08-e66eeae0f267',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.037258] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.068917] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf801cfb-8004-42d6-a945-4d3f88953372 in Status: SUCCESS [ 861.069196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.196705] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc in Status: SUCCESS [ 861.197239] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc deletion is rescheduled due to dependency. [ 861.197474] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.378979] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.379163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.379246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.379814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.379814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.379814] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f932dfa4-49e7-4477-968f-48bf223104fa already deleted. [ 861.379814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.539586] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.539800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.539883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.540133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.540238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.540341] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 is going to be created. [ 861.542458] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.542590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.542656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.542835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.543026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.543026] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59140a91-434d-4615-899a-f10ff35ce431 is going to be updated. [ 861.544635] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.544793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.544924] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.545229] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.545229] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.545373] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 861.594573] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.594573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.594573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.595089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.595089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.599213] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.599642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.599642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.599817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.599878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.604592] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.604592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.604592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.604926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.604926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.618559] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 861.621912] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59140a91-434d-4615-899a-f10ff35ce431 in Status: IN_PROGRESS for 2s [ 861.631763] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 in Status: UNINITIALIZED for 2s [ 861.647390] env[70535]: INFO networking_nsxv3.common.synchronization [req-1a11ebd6-f371-45aa-805a-2d72ea95f080 req-2863d023-53d6-4ad3-a637-f35d1b1a9541 tempest-ImagesTestJSON-1564979202 tempest-ImagesTestJSON-1564979202-project-member] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 861.648075] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 861.648440] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.648730] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.648730] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.648844] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.648999] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.649872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.649974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.651890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.651890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.651890] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.069686] env[70535]: INFO networking_nsxv3.common.synchronization [None req-b0dc76b8-446b-43ba-8531-4858ce57571d None None] Enqueued Resource ID: 76f266f5-ae19-4e4d-a8ab-ed872f67c5fb with Priority: HIGHEST for action port [ 862.069927] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f266f5-ae19-4e4d-a8ab-ed872f67c5fb with Priority: HIGHEST for action port [ 862.070200] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-76f266f5-ae19-4e4d-a8ab-ed872f67c5fb taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.070316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76f266f5-ae19-4e4d-a8ab-ed872f67c5fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.070381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76f266f5-ae19-4e4d-a8ab-ed872f67c5fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.070631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76f266f5-ae19-4e4d-a8ab-ed872f67c5fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.070708] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76f266f5-ae19-4e4d-a8ab-ed872f67c5fb',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.103858] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.103858] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.103858] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.103858] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.103858] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.105375] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.108985] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.108985] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.108985] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.108985] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.108985] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.108985] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.108985] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.108985] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.108985] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.108985] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.130028] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.130028] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 862.130028] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.130028] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.130028] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-fbddf0f6-49ef-47b4-8efd-a38c5900250a taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.130028] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-fbddf0f6-49ef-47b4-8efd-a38c5900250a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.130028] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-fbddf0f6-49ef-47b4-8efd-a38c5900250a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.130028] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-fbddf0f6-49ef-47b4-8efd-a38c5900250a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.130028] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbddf0f6-49ef-47b4-8efd-a38c5900250a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.153148] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.153563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.153814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.154178] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.187294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.187595] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.187753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.187906] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.188041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.188133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.188226] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 862.221650] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.221847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.221913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.222119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.222259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.236567] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 862.573730] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76f266f5-ae19-4e4d-a8ab-ed872f67c5fb [ 862.574211] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.574453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.574621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.576465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.577400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.577400] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76f266f5-ae19-4e4d-a8ab-ed872f67c5fb already deleted. [ 862.577400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76f266f5-ae19-4e4d-a8ab-ed872f67c5fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.637477] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.637477] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.637477] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.638435] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.638435] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.638435] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port fbddf0f6-49ef-47b4-8efd-a38c5900250a not found, creating... [ 862.638696] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.639151] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.639151] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.639265] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.639391] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.639744] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.639940] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.642031] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.642031] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.642031] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.642031] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: fbddf0f6-49ef-47b4-8efd-a38c5900250a is going to be created. [ 862.663511] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.663740] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.664705] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.664705] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.664705] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.664870] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-fbddf0f6-49ef-47b4-8efd-a38c5900250a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.938891] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59140a91-434d-4615-899a-f10ff35ce431 in Status: SUCCESS [ 862.939170] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.939375] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.939605] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.939937] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.097905] env[70535]: INFO networking_nsxv3.common.synchronization [req-4dfbff74-1776-492b-862b-a945cbf81d6c req-47aad167-c460-4af8-b9a8-e795b7fe5848 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGHEST for action security_group_members [ 863.098220] env[70535]: INFO networking_nsxv3.common.synchronization [req-4dfbff74-1776-492b-862b-a945cbf81d6c req-47aad167-c460-4af8-b9a8-e795b7fe5848 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 863.098220] env[70535]: INFO networking_nsxv3.common.synchronization [req-4dfbff74-1776-492b-862b-a945cbf81d6c req-47aad167-c460-4af8-b9a8-e795b7fe5848 tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 with Priority: HIGHEST for action security_group_members [ 863.098695] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGHEST for action security_group_members [ 863.098909] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 863.098909] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 with Priority: HIGHEST for action security_group_members [ 863.100708] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-59140a91-434d-4615-899a-f10ff35ce431 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.100708] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.100708] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.100708] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.100708] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-415c6b8e-c0b6-428b-ad08-e66eeae0f267 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.100708] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.443122] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-59140a91-434d-4615-899a-f10ff35ce431 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.443122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.487616] env[70535]: INFO networking_nsxv3.common.synchronization [req-1a11ebd6-f371-45aa-805a-2d72ea95f080 req-b6570c5c-ea8e-43aa-9b9c-82b7f8a3ce09 service nova] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_rules [ 863.487790] env[70535]: INFO networking_nsxv3.common.synchronization [req-1a11ebd6-f371-45aa-805a-2d72ea95f080 req-b6570c5c-ea8e-43aa-9b9c-82b7f8a3ce09 service nova] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 863.487977] env[70535]: INFO networking_nsxv3.common.synchronization [req-1a11ebd6-f371-45aa-805a-2d72ea95f080 req-b6570c5c-ea8e-43aa-9b9c-82b7f8a3ce09 service nova] Enqueued Resource ID: fbddf0f6-49ef-47b4-8efd-a38c5900250a with Priority: HIGHEST for action port [ 863.488168] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_rules [ 863.488304] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 863.488386] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbddf0f6-49ef-47b4-8efd-a38c5900250a with Priority: HIGHEST for action port [ 863.489047] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.490153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.490228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.490438] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.490524] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.492027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.492027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.492027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbddf0f6-49ef-47b4-8efd-a38c5900250a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.492027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbddf0f6-49ef-47b4-8efd-a38c5900250a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.492027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbddf0f6-49ef-47b4-8efd-a38c5900250a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.492352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbddf0f6-49ef-47b4-8efd-a38c5900250a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.492352] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbddf0f6-49ef-47b4-8efd-a38c5900250a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.634344] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59140a91-434d-4615-899a-f10ff35ce431 in Status: SUCCESS [ 863.634344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.634344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.634344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.634344] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.634344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.634344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.634344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.634344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.634344] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.635347] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 863.635676] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.637103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.637409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.637799] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.638046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.638196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.638419] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.638598] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.638771] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.650048] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 in Status: SUCCESS [ 863.650048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.650265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.650654] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.650654] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.650840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.650840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.651018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.651127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.651206] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415c6b8e-c0b6-428b-ad08-e66eeae0f267',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.993864] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.994054] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.997513] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbddf0f6-49ef-47b4-8efd-a38c5900250a with status ACTIVE [ 863.997855] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.998553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.998683] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.998969] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.999617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.999864] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.000055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.000183] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.000438] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.000515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.000727] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.000859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.000943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.001148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.001249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.001335] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbddf0f6-49ef-47b4-8efd-a38c5900250a is going to be updated. [ 864.030358] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.030812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.032476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.033619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.033619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.033619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbddf0f6-49ef-47b4-8efd-a38c5900250a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.141515] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.141515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.141515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.141957] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.141957] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.142917] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.142917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.142917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.142917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.142917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.142917] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59140a91-434d-4615-899a-f10ff35ce431 is going to be updated. [ 864.144479] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.150764] env[70535]: INFO networking_nsxv3.common.synchronization [None req-98f83bca-e2f0-4f95-be7e-8c4710f5973c None None] Enqueued Resource ID: 8c3392a5-79a6-45c1-b5df-e7e8b753a95e with Priority: HIGHEST for action port [ 864.154482] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c3392a5-79a6-45c1-b5df-e7e8b753a95e with Priority: HIGHEST for action port [ 864.154482] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c3392a5-79a6-45c1-b5df-e7e8b753a95e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.154482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c3392a5-79a6-45c1-b5df-e7e8b753a95e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.154482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c3392a5-79a6-45c1-b5df-e7e8b753a95e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.154482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c3392a5-79a6-45c1-b5df-e7e8b753a95e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.154482] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c3392a5-79a6-45c1-b5df-e7e8b753a95e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.156856] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.156856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.156856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.156856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.156856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.156856] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.156856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.156856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.156856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.156856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.156856] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 is going to be deleted. [ 864.210887] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.211108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.211709] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.212036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.212157] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.212263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.213351] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.213488] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.213554] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.214669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.214669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.215253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.215437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.215623] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.215733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.215787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.215930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.216019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.216120] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415c6b8e-c0b6-428b-ad08-e66eeae0f267',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.232221] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59140a91-434d-4615-899a-f10ff35ce431 in Status: IN_PROGRESS for 2s [ 864.249468] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 864.249642] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e deletion is rescheduled due to dependency. [ 864.250861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.250861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.250861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.250861] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.250861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.250861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.251195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.251195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.251271] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.648514] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.660023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c3392a5-79a6-45c1-b5df-e7e8b753a95e [ 864.660023] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.660023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.660023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.660023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.660023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.660023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c3392a5-79a6-45c1-b5df-e7e8b753a95e already deleted. [ 864.660023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c3392a5-79a6-45c1-b5df-e7e8b753a95e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.722873] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.722873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.723325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.723325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.723468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.723650] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.723789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.723864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.723993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.724088] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.724195] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 already deleted. [ 864.724268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.724380] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('415c6b8e-c0b6-428b-ad08-e66eeae0f267',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.725662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.726450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.726450] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.726450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.726450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.726450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.726450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.727458] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415c6b8e-c0b6-428b-ad08-e66eeae0f267',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.755049] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.157056] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.157056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.157056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.157470] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.157470] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.157470] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 865.232640] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('415c6b8e-c0b6-428b-ad08-e66eeae0f267',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.232640] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.232640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.232640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.232640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.232640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.232640] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.232640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.232640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.232640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.232640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.232640] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 already deleted. [ 865.232640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.241433] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.241433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.241433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.241433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.241647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.254145] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 865.256577] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.314998] env[70535]: INFO networking_nsxv3.common.synchronization [req-2fef652f-925a-4556-a790-03b703899113 req-48b3d9f4-4220-4a8f-9742-f3fbe07697e5 tempest-ServersWithSpecificFlavorTestJSON-86157586 tempest-ServersWithSpecificFlavorTestJSON-86157586-project-member] Enqueued Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_members [ 865.315944] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_members [ 865.316488] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b3e2660-4c57-4d95-a486-449e2bf37488 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.316709] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.316824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.317182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.317388] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.317545] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.317642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.317888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.318039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.318723] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.734909] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 415c6b8e-c0b6-428b-ad08-e66eeae0f267: rpc.has_security_group_logging(os_id): False [ 865.751686] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.754023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.754023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.754023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.754023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.754023] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.754023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.754023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.754023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.754023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.754023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 is going to be created. [ 865.765427] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.765427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.765427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.765427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.765427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.765427] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 865.779325] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/415c6b8e-c0b6-428b-ad08-e66eeae0f267], does not exist path=[/infra/domains/default/groups/415c6b8e-c0b6-428b-ad08-e66eeae0f267]."\n}' [ 865.779579] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/415c6b8e-c0b6-428b-ad08-e66eeae0f267 [ 865.779706] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 865.801271] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.801436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.801489] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.801797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.801842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.811796] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 865.821213] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.821403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.821491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.821890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.837035] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.837164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.847191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.847639] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.847639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.847841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.847909] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.847966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.848140] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 is going to be updated. [ 865.849512] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.849788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.850941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.851688] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.851882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.852113] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.852253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.852442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.852906] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.853093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.853290] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.853563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.853563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.853726] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 415c6b8e-c0b6-428b-ad08-e66eeae0f267 is going to be created. [ 865.876998] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/415c6b8e-c0b6-428b-ad08-e66eeae0f267], does not exist path=[/infra/domains/default/groups/415c6b8e-c0b6-428b-ad08-e66eeae0f267]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/415c6b8e-c0b6-428b-ad08-e66eeae0f267 [ 865.876998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-415c6b8e-c0b6-428b-ad08-e66eeae0f267" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.877212] env[70535]: Traceback (most recent call last): [ 865.877212] env[70535]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 865.877212] env[70535]: return func(*args, **kwargs) [ 865.877212] env[70535]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 865.877212] env[70535]: res.raise_for_status() [ 865.877212] env[70535]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 865.877212] env[70535]: raise HTTPError(http_error_msg, response=self) [ 865.877212] env[70535]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/415c6b8e-c0b6-428b-ad08-e66eeae0f267 [ 865.877212] env[70535]: During handling of the above exception, another exception occurred: [ 865.877212] env[70535]: Traceback (most recent call last): [ 865.877212] env[70535]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 865.877212] env[70535]: listener.cb(fileno) [ 865.877212] env[70535]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 865.877212] env[70535]: result = function(*args, **kwargs) [ 865.877212] env[70535]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 865.877212] env[70535]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 865.877743] env[70535]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 865.877743] env[70535]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 865.877743] env[70535]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 865.877743] env[70535]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 865.877743] env[70535]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 865.877743] env[70535]: res.raise_for_status() [ 865.877743] env[70535]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 865.877743] env[70535]: raise HTTPError(http_error_msg, response=self) [ 865.877743] env[70535]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/415c6b8e-c0b6-428b-ad08-e66eeae0f267 [ 865.877743] env[70535]: Removing descriptor: 23 [ 865.883684] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.883873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.883920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.884159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.884300] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.898078] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 in Status: IN_PROGRESS for 2s [ 866.247037] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59140a91-434d-4615-899a-f10ff35ce431 in Status: SUCCESS [ 866.247037] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59140a91-434d-4615-899a-f10ff35ce431 deletion is rescheduled due to dependency. [ 866.247037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.247037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.247037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.247037] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.247037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.247037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.248543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.250153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.250153] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.753251] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.753894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.753985] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.754251] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.796154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.796406] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.797030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.797030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.798814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.798814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.798814] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59140a91-434d-4615-899a-f10ff35ce431 is going to be updated. [ 866.803119] env[70535]: INFO networking_nsxv3.common.synchronization [req-16657fb3-12cd-479c-88eb-27b1a8375a84 req-77278939-e6b4-4ba4-b3ca-6c7aafb553e8 tempest-ServerMetadataNegativeTestJSON-1264359968 tempest-ServerMetadataNegativeTestJSON-1264359968-project-member] Enqueued Resource ID: 137ee755-5484-45a9-a8f1-2a50747a7208 with Priority: HIGHEST for action security_group_members [ 866.804385] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137ee755-5484-45a9-a8f1-2a50747a7208 with Priority: HIGHEST for action security_group_members [ 866.805112] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-137ee755-5484-45a9-a8f1-2a50747a7208 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.805112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.805313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.807025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.807025] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.807025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.807025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.807025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.807025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.807025] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137ee755-5484-45a9-a8f1-2a50747a7208',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.845188] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.845520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.845520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.846207] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.846207] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.862915] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59140a91-434d-4615-899a-f10ff35ce431 in Status: IN_PROGRESS for 2s [ 867.264731] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 867.264976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.265160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.265391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.265631] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.265709] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.265835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.265941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.266046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.266138] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.266305] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.266389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.266459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.266597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.266739] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.266834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.266894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.267117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.267212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.267327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.267456] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.269029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.269203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.269356] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.269463] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.269525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.269731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.269866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.269996] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.310382] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.314023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.314023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.314023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.314023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.314023] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.314023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.314023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.314023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.314023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.314023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137ee755-5484-45a9-a8f1-2a50747a7208 already deleted. [ 867.314023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.570513] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-838 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.573839] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-838" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.573839] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-838" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.573839] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-838" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.573839] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.573839] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.573839] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.573839] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.573839] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.573839] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.573839] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.573839] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.573839] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.573839] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.573839] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.573839] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.595351] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.597421] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 867.597421] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.597421] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-838" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.597421] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-371eb896-edfb-4502-b634-272051f829c4 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.597421] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-371eb896-edfb-4502-b634-272051f829c4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.597421] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-371eb896-edfb-4502-b634-272051f829c4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.597776] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-371eb896-edfb-4502-b634-272051f829c4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.597776] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('371eb896-edfb-4502-b634-272051f829c4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.776126] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2: rpc.has_security_group_logging(os_id): False [ 867.776126] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.795396] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.795396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.795591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.795800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.815778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.816183] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.816354] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.816457] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.816751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.816874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.817169] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.817333] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.817711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.817711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.817836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.818516] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.818704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.818808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.819034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.819157] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.819324] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 867.822891] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 867.823346] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.824420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.824681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.824915] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.825080] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.825177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.825386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.825719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.825882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.826034] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.882377] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.882548] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.882598] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.882799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.882946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.897719] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 867.907630] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 in Status: SUCCESS [ 867.907832] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 deletion is rescheduled due to dependency. [ 867.907949] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.103020] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.103020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.103020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.103020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.103020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.103020] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 371eb896-edfb-4502-b634-272051f829c4 not found, creating... [ 868.103020] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.103020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.103020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.103020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.103020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.103602] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.103602] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.103602] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.104147] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.104460] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.104910] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 371eb896-edfb-4502-b634-272051f829c4 is going to be created. [ 868.127750] env[70535]: INFO networking_nsxv3.common.synchronization [None req-e031c114-3664-4e45-bc78-393903833036 None None] Enqueued Resource ID: ea0571db-3010-4a81-a2b3-db3a4564b398 with Priority: HIGHEST for action port [ 868.133035] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.133035] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.133035] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.133035] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.133035] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.133035] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-371eb896-edfb-4502-b634-272051f829c4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.133035] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea0571db-3010-4a81-a2b3-db3a4564b398 with Priority: HIGHEST for action port [ 868.133035] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea0571db-3010-4a81-a2b3-db3a4564b398 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.133035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea0571db-3010-4a81-a2b3-db3a4564b398" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.133035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea0571db-3010-4a81-a2b3-db3a4564b398" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.133035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea0571db-3010-4a81-a2b3-db3a4564b398" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.133035] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea0571db-3010-4a81-a2b3-db3a4564b398',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.278864] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.334197] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.334197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.334197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.334197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.334197] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.334197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.334197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.334197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.334197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.334197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.334197] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.334197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.334197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.334197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.334197] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.334197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.335130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.335130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.335130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.335130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.335130] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.358353] env[70535]: INFO networking_nsxv3.common.synchronization [None req-776a2bac-f084-44a2-8836-48e112119393 tempest-ServerActionsTestJSON-1674828100 tempest-ServerActionsTestJSON-1674828100-project-member] Enqueued Resource ID: 4671052a-29bf-476d-9785-63d1baee1810 with Priority: HIGHEST for action security_group_rules [ 868.358353] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4671052a-29bf-476d-9785-63d1baee1810 with Priority: HIGHEST for action security_group_rules [ 868.359109] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4671052a-29bf-476d-9785-63d1baee1810 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.359579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.359812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.360307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.360730] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4671052a-29bf-476d-9785-63d1baee1810',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.505348] env[70535]: INFO networking_nsxv3.common.synchronization [None req-5ba5b912-e3d7-431e-930d-99b1d3b24a30 tempest-ServerActionsTestJSON-1674828100 tempest-ServerActionsTestJSON-1674828100-project-member] Enqueued Resource ID: 4671052a-29bf-476d-9785-63d1baee1810 with Priority: HIGHEST for action security_group_rules [ 868.506706] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4671052a-29bf-476d-9785-63d1baee1810 with Priority: HIGHEST for action security_group_rules [ 868.506706] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4671052a-29bf-476d-9785-63d1baee1810 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.506706] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.637876] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea0571db-3010-4a81-a2b3-db3a4564b398 [ 868.638130] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.638270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.638351] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.638593] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.638689] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.639118] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea0571db-3010-4a81-a2b3-db3a4564b398 already deleted. [ 868.639118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea0571db-3010-4a81-a2b3-db3a4564b398" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.785653] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.785653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.785653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.785653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.785653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.785653] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 868.823099] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.823099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.823099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.823099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.823099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.833929] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 868.838930] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52023f52-3978-48e2-8510-00221c047d2e: rpc.has_security_group_logging(os_id): False [ 868.855790] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.855963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.857112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.857112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.878924] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59140a91-434d-4615-899a-f10ff35ce431 in Status: SUCCESS [ 868.879070] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59140a91-434d-4615-899a-f10ff35ce431 deletion is rescheduled due to dependency. [ 868.879070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.880021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.880259] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.880406] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.880537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.880631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.880777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.880914] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.884262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.884262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.884436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.884589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.884807] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.884905] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.886398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.886398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.886398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.886398] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 868.886398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.886741] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.886741] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.886834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.886870] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.887051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.887102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.887180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.887268] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.890036] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.890937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.893107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.893107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.893107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.893107] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4671052a-29bf-476d-9785-63d1baee1810 already deleted. [ 868.893107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.893107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.893107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.893107] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4671052a-29bf-476d-9785-63d1baee1810',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.964280] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.964280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.964280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.964280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.964280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.980387] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 869.166210] env[70535]: INFO networking_nsxv3.common.synchronization [req-16657fb3-12cd-479c-88eb-27b1a8375a84 req-9d03e9e4-e88f-4984-a6df-52f65898dde3 service nova] Enqueued Resource ID: 137ee755-5484-45a9-a8f1-2a50747a7208 with Priority: HIGHEST for action security_group_rules [ 869.169034] env[70535]: INFO networking_nsxv3.common.synchronization [req-16657fb3-12cd-479c-88eb-27b1a8375a84 req-9d03e9e4-e88f-4984-a6df-52f65898dde3 service nova] Enqueued Resource ID: 137ee755-5484-45a9-a8f1-2a50747a7208 with Priority: HIGHEST for action security_group_members [ 869.169034] env[70535]: INFO networking_nsxv3.common.synchronization [req-16657fb3-12cd-479c-88eb-27b1a8375a84 req-9d03e9e4-e88f-4984-a6df-52f65898dde3 service nova] Enqueued Resource ID: 371eb896-edfb-4502-b634-272051f829c4 with Priority: HIGHEST for action port [ 869.169034] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137ee755-5484-45a9-a8f1-2a50747a7208 with Priority: HIGHEST for action security_group_rules [ 869.169034] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137ee755-5484-45a9-a8f1-2a50747a7208 with Priority: HIGHEST for action security_group_members [ 869.169034] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371eb896-edfb-4502-b634-272051f829c4 with Priority: HIGHEST for action port [ 869.169034] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-137ee755-5484-45a9-a8f1-2a50747a7208 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.169034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.169034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.169034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.169034] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('137ee755-5484-45a9-a8f1-2a50747a7208',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.169800] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-137ee755-5484-45a9-a8f1-2a50747a7208 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.169800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.169800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.169800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.169800] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.169800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.170062] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.170062] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.170144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.170243] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137ee755-5484-45a9-a8f1-2a50747a7208',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.171071] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-371eb896-edfb-4502-b634-272051f829c4 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.171191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-371eb896-edfb-4502-b634-272051f829c4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.171253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-371eb896-edfb-4502-b634-272051f829c4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.171404] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-371eb896-edfb-4502-b634-272051f829c4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.171474] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('371eb896-edfb-4502-b634-272051f829c4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.400071] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.428852] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.429126] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.429126] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.429286] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.429478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.429478] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4671052a-29bf-476d-9785-63d1baee1810 already deleted. [ 869.429644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.673451] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('137ee755-5484-45a9-a8f1-2a50747a7208',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.674977] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-137ee755-5484-45a9-a8f1-2a50747a7208 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.675181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.675701] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 371eb896-edfb-4502-b634-272051f829c4 with status ACTIVE [ 869.675701] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.675863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.675863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.676917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.680494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.680738] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.680855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.680921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.681153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.681235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.681428] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.681526] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.681585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.681737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.681809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.681893] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 371eb896-edfb-4502-b634-272051f829c4 is going to be updated. [ 869.708603] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.708862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.708862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.709149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.709320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.709566] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-371eb896-edfb-4502-b634-272051f829c4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.902676] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59140a91-434d-4615-899a-f10ff35ce431: rpc.has_security_group_logging(os_id): False [ 869.921464] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.922949] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.923029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.923262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.923361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.923621] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.924788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.924970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.925289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.925410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.925527] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59140a91-434d-4615-899a-f10ff35ce431 is going to be updated. [ 869.927960] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 869.928784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.929068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.929339] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.929483] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.004320] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.004500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.004500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.004803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.004951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.020802] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59140a91-434d-4615-899a-f10ff35ce431 in Status: IN_PROGRESS for 2s [ 870.183779] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('137ee755-5484-45a9-a8f1-2a50747a7208',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.424386] env[70535]: INFO networking_nsxv3.common.synchronization [None req-01769789-ec5f-4472-b5d4-8e5833a0cdb8 None None] Enqueued Resource ID: c1e79220-7988-461f-90ab-fa0c6d43448b with Priority: HIGHEST for action port [ 870.425604] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e79220-7988-461f-90ab-fa0c6d43448b with Priority: HIGHEST for action port [ 870.428164] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1e79220-7988-461f-90ab-fa0c6d43448b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.428164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1e79220-7988-461f-90ab-fa0c6d43448b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.428164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1e79220-7988-461f-90ab-fa0c6d43448b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.428164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1e79220-7988-461f-90ab-fa0c6d43448b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.428164] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1e79220-7988-461f-90ab-fa0c6d43448b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.432352] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.432748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.688413] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.688413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.688413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.688413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.688413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.688413] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137ee755-5484-45a9-a8f1-2a50747a7208 is going to be created. [ 870.718927] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.719109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.719207] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.719479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.719653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.732220] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137ee755-5484-45a9-a8f1-2a50747a7208 in Status: UNINITIALIZED for 2s [ 870.854552] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 870.854899] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.855104] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.855336] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.859086] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.859276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.859360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.859669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.859778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.859872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.859977] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.928941] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1e79220-7988-461f-90ab-fa0c6d43448b [ 870.929221] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.929344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.929434] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.929800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.929800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.929800] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1e79220-7988-461f-90ab-fa0c6d43448b already deleted. [ 870.930078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1e79220-7988-461f-90ab-fa0c6d43448b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.000353] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 871.000588] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.366687] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.366687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.366687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.366687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.366687] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.366687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.366687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.366687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.366687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.366687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.366687] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.366687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.366687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.366687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.366687] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.366687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.367459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.367459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.367459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.367459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.367459] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.660722] env[70535]: INFO networking_nsxv3.common.synchronization [req-afefb043-fd65-42d7-8915-9a849cf76bc0 req-39686307-5ecf-45cc-9473-578425d46141 tempest-ServerMetadataTestJSON-1307689100 tempest-ServerMetadataTestJSON-1307689100-project-member] Enqueued Resource ID: cf801cfb-8004-42d6-a945-4d3f88953372 with Priority: HIGHEST for action security_group_members [ 871.666286] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf801cfb-8004-42d6-a945-4d3f88953372 with Priority: HIGHEST for action security_group_members [ 871.667200] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf801cfb-8004-42d6-a945-4d3f88953372 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.667352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.667442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.667670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.667832] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.667936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.667999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.668170] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.668258] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.668359] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf801cfb-8004-42d6-a945-4d3f88953372',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.869710] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2: rpc.has_security_group_logging(os_id): False [ 871.889413] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.889622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.889665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.889938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.890065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.890320] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.890452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.890542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.890784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.890894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.892034] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.892763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.892865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.893075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.893188] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.893439] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.893577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.893645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.893814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.893906] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.896258] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 871.967332] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.967492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.967545] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.969414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.969414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.987203] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 872.042099] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59140a91-434d-4615-899a-f10ff35ce431 in Status: SUCCESS [ 872.042329] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.179030] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.179030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.179030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.179030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.200776] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.201065] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.201191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.201298] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.201465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.201553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.201641] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf801cfb-8004-42d6-a945-4d3f88953372 is going to be updated. [ 872.236597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.236597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.236597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.236597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.236876] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.247148] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf801cfb-8004-42d6-a945-4d3f88953372 in Status: IN_PROGRESS for 2s [ 872.743261] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137ee755-5484-45a9-a8f1-2a50747a7208 in Status: SUCCESS [ 872.743543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.743633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.743861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.744072] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.744197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.744261] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.744420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.744502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.744590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.744707] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('137ee755-5484-45a9-a8f1-2a50747a7208',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.248799] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-137ee755-5484-45a9-a8f1-2a50747a7208 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.248799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.248799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.248955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.249149] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.249260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.249314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.249460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.249547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.249687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.249772] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-137ee755-5484-45a9-a8f1-2a50747a7208 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.249861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.249935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.250490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.250490] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.250490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.250490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.250490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.250834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.250834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.250834] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('137ee755-5484-45a9-a8f1-2a50747a7208',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.753055] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 137ee755-5484-45a9-a8f1-2a50747a7208: rpc.has_security_group_logging(os_id): False [ 873.774522] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.774779] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.775658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.775658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.775658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.775658] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.775658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.775658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.775902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.775902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.776039] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.776137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.776196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.776339] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.776414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.776594] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.776687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.776749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.776893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.776961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.777058] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 137ee755-5484-45a9-a8f1-2a50747a7208 is going to be created. [ 873.905514] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.905739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.905807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.906012] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.906208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.918147] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 137ee755-5484-45a9-a8f1-2a50747a7208 in Status: IN_PROGRESS for 2s [ 874.021025] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 874.021276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.258620] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf801cfb-8004-42d6-a945-4d3f88953372 in Status: SUCCESS [ 874.258825] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf801cfb-8004-42d6-a945-4d3f88953372 deletion is rescheduled due to dependency. [ 874.258977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.838522] env[70535]: INFO networking_nsxv3.common.synchronization [None req-2dc8b4ca-f548-4ccc-abd6-25c5ed6af8b9 tempest-ImagesOneServerNegativeTestJSON-495716502 tempest-ImagesOneServerNegativeTestJSON-495716502-project-member] Enqueued Resource ID: 72b001c3-39ea-4b9d-8397-f080f9c4e5db with Priority: HIGHEST for action security_group_rules [ 874.838522] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72b001c3-39ea-4b9d-8397-f080f9c4e5db with Priority: HIGHEST for action security_group_rules [ 874.838522] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72b001c3-39ea-4b9d-8397-f080f9c4e5db taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.838522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72b001c3-39ea-4b9d-8397-f080f9c4e5db" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.838522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72b001c3-39ea-4b9d-8397-f080f9c4e5db" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.840340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72b001c3-39ea-4b9d-8397-f080f9c4e5db" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.840340] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72b001c3-39ea-4b9d-8397-f080f9c4e5db',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.924469] env[70535]: INFO networking_nsxv3.common.synchronization [None req-29aa3181-cebb-4913-82b2-7f423068831e tempest-ImagesOneServerNegativeTestJSON-495716502 tempest-ImagesOneServerNegativeTestJSON-495716502-project-member] Enqueued Resource ID: 72b001c3-39ea-4b9d-8397-f080f9c4e5db with Priority: HIGHEST for action security_group_rules [ 874.925154] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72b001c3-39ea-4b9d-8397-f080f9c4e5db with Priority: HIGHEST for action security_group_rules [ 874.925586] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72b001c3-39ea-4b9d-8397-f080f9c4e5db taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.925845] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72b001c3-39ea-4b9d-8397-f080f9c4e5db" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.362290] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.362508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.362616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.362874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.363015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.363154] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72b001c3-39ea-4b9d-8397-f080f9c4e5db already deleted. [ 875.363273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72b001c3-39ea-4b9d-8397-f080f9c4e5db" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.363468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72b001c3-39ea-4b9d-8397-f080f9c4e5db" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.363659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72b001c3-39ea-4b9d-8397-f080f9c4e5db" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.363778] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72b001c3-39ea-4b9d-8397-f080f9c4e5db',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.889604] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.890093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.890093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.890253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.890418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.890577] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72b001c3-39ea-4b9d-8397-f080f9c4e5db already deleted. [ 875.891717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72b001c3-39ea-4b9d-8397-f080f9c4e5db" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.932269] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 137ee755-5484-45a9-a8f1-2a50747a7208 in Status: SUCCESS [ 875.932484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.944271] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.944271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.944271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.944271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.944271] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.283474] env[70535]: INFO networking_nsxv3.common.synchronization [None req-b418e820-5691-42a0-a060-0e357ca606cc tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 with Priority: HIGHEST for action security_group_rules [ 878.284016] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 with Priority: HIGHEST for action security_group_rules [ 878.284412] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.284584] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.284660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.285016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.285394] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc5fb1bb-573b-4a41-9b95-86e55eedb265',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.407189] env[70535]: INFO networking_nsxv3.common.synchronization [None req-b5d66ef6-e79b-4aef-8582-704b6096be4a tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 with Priority: HIGHEST for action security_group_rules [ 878.407764] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 with Priority: HIGHEST for action security_group_rules [ 878.408988] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.409240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.446514] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.808022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.808022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.809327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.809327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.809327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.809327] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 already deleted. [ 878.809327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.809327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.809327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.809327] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc5fb1bb-573b-4a41-9b95-86e55eedb265',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.949938] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.333772] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.334058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.334058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.334277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.334371] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.334472] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 already deleted. [ 879.334554] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.453801] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 879.453987] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 880.321786] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.322158] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.322158] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.322241] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.500286] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 880.502038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.504353] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 880.545849] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.546104] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.546174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.546420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.558309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.558309] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 880.558309] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 880.558309] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 880.605928] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.606718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.606718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.606718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.607546] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.608382] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 880.699431] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.699431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.699431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.699727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.699727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.699922] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 880.788928] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.789099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.789171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.789377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.789690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.789879] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 880.789941] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0fe09099-3626-4cb3-9710-c5c35d48d103', 'ce0ae195-bd66-418b-89e1-33b9dece1034', '5c0519b9-5948-4844-8e1d-20705cb47261', 'd004720e-0079-4896-920b-7b1e57b6b7b8', '89135034-9b45-4344-b065-0229db08f4f9', 'c30db4ac-0243-4260-914e-2e6a0283c93a', '63056e22-45eb-4c1b-b65b-578fb5876c5b', '9b11bca7-ad54-4a56-a651-3a19b70ab917', 'd167e03b-4e91-4b8f-9fa3-5a3c0b4222c2', 'b2476f5f-d3ef-49eb-bade-f2adb005ec7c', '8f0ce39e-83c0-4345-91bb-9366dd77a60c', '29ee0426-6a12-4c04-9765-fa731a9837a7', 'b05014f4-0d5c-444e-a37c-dbe58f585d75', '6b3e2660-4c57-4d95-a486-449e2bf37488', 'e1dcacf3-cf94-4660-82d4-dac926fd56fb', '90c4bd0b-6551-40c3-9e23-945c4ab91af0', 'f9244c40-b3c3-42a1-af4b-33b8585c25ed', '943c9a56-84a0-4361-a030-eef87cb00d31', '9bfef491-cf1d-478b-8711-9cea38aaf832', '50631980-025e-4f7c-a21a-486351e09d1f', '46eec3ed-88a9-4ea1-a649-2f92efa91eb5', 'a61a906f-165f-4ddb-98ee-a6437a47d544', '00628945-9b3d-4cd6-939f-483e37c62dbe', 'eda75f17-393d-4d95-8a9b-a7924138f446', '679d2a4f-8236-41e0-99ab-1f6326515c29', '56df97d7-88f0-451d-89de-62650bdc9016', '81327d43-2c13-4e7b-b63b-d04a175b637e', '52023f52-3978-48e2-8510-00221c047d2e', '59140a91-434d-4615-899a-f10ff35ce431', 'ec60a8db-faf5-42bd-94a8-662a5418627b', 'acf72aac-3e82-4909-b3c4-dccd81be0846', '7b34086e-8eac-4499-9c02-2280b24b0698', '704d6b72-3e14-4725-96b9-ddcf6d1bb8bc', '137ee755-5484-45a9-a8f1-2a50747a7208', '1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3', '597eb346-7afe-45b2-a812-9f2a8e62680f', 'c8d7fb02-d4e1-40c2-a711-afb7188e3a15', '48008d9c-bbf6-40a2-bb47-24eddd9f74c2', 'bbb53f03-8f48-4baa-b4e6-67243ad60187', 'cf801cfb-8004-42d6-a945-4d3f88953372', 'f32aa9cd-fe8f-4b69-8037-59fa1cf6570c'} {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 880.790076] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 880.815190] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.815190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.815190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.815190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.815190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.815190] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 880.815190] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 880.815190] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 880.890784] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.890967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.891124] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.891234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.892029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.892257] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 880.892333] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 880.892404] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 880.892463] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 880.892542] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 880.892610] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGH for action security_group_rules [ 880.892777] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce0ae195-bd66-418b-89e1-33b9dece1034 with Priority: HIGH for action security_group_rules [ 880.892777] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c0519b9-5948-4844-8e1d-20705cb47261 with Priority: HIGH for action security_group_rules [ 880.892887] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGH for action security_group_rules [ 880.892931] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 89135034-9b45-4344-b065-0229db08f4f9 with Priority: HIGH for action security_group_rules [ 880.892966] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGH for action security_group_rules [ 880.893067] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGH for action security_group_rules [ 880.893133] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGH for action security_group_rules [ 880.893191] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGH for action security_group_rules [ 880.893248] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c with Priority: HIGH for action security_group_rules [ 880.893298] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGH for action security_group_rules [ 880.893352] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 with Priority: HIGH for action security_group_rules [ 880.893408] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGH for action security_group_rules [ 880.893471] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGH for action security_group_rules [ 880.893529] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb with Priority: HIGH for action security_group_rules [ 880.893579] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGH for action security_group_rules [ 880.893633] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGH for action security_group_rules [ 880.893696] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 943c9a56-84a0-4361-a030-eef87cb00d31 with Priority: HIGH for action security_group_rules [ 880.893757] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGH for action security_group_rules [ 880.893818] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGH for action security_group_rules [ 880.893915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.408377] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 883.408644] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 883.408644] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGH for action security_group_rules [ 883.408739] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c0519b9-5948-4844-8e1d-20705cb47261 with Priority: HIGH for action security_group_rules [ 883.408838] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGH for action security_group_rules [ 883.408934] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb with Priority: HIGH for action security_group_rules [ 883.409044] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGH for action security_group_rules [ 883.409142] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 with Priority: HIGH for action security_group_rules [ 883.409234] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943c9a56-84a0-4361-a030-eef87cb00d31 with Priority: HIGH for action security_group_rules [ 883.409324] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGH for action security_group_rules [ 883.409490] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGH for action security_group_rules [ 883.409541] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGH for action security_group_rules [ 883.409579] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGH for action security_group_rules [ 883.409668] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 with Priority: HIGH for action security_group_rules [ 883.409754] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGH for action security_group_rules [ 883.409840] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c with Priority: HIGH for action security_group_rules [ 883.409925] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGH for action security_group_rules [ 883.410017] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGH for action security_group_rules [ 883.410103] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGH for action security_group_rules [ 883.410187] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89135034-9b45-4344-b065-0229db08f4f9 with Priority: HIGH for action security_group_rules [ 883.410271] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce0ae195-bd66-418b-89e1-33b9dece1034 with Priority: HIGH for action security_group_rules [ 883.410357] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGH for action security_group_rules [ 883.410680] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fe09099-3626-4cb3-9710-c5c35d48d103 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.410809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.410874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.411111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.411195] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.412450] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c0519b9-5948-4844-8e1d-20705cb47261 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.412450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.412450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.412602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.412602] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c0519b9-5948-4844-8e1d-20705cb47261',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.413382] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.413499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.413499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.413663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.413711] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.414700] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1dcacf3-cf94-4660-82d4-dac926fd56fb taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.415072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.415072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.415484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.415484] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1dcacf3-cf94-4660-82d4-dac926fd56fb',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.419882] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.420089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.420163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.420347] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.420427] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.421756] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bfef491-cf1d-478b-8711-9cea38aaf832 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.421756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.421898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.421961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.423566] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bfef491-cf1d-478b-8711-9cea38aaf832',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.424916] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-943c9a56-84a0-4361-a030-eef87cb00d31 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.424916] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.425093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.425133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.425202] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('943c9a56-84a0-4361-a030-eef87cb00d31',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.429429] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.429429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.429429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.429567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.429657] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9244c40-b3c3-42a1-af4b-33b8585c25ed',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.431140] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b3e2660-4c57-4d95-a486-449e2bf37488 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.431140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.431140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.431364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.431364] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.433890] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.434052] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.434124] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.434295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.434371] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90c4bd0b-6551-40c3-9e23-945c4ab91af0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.435359] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b05014f4-0d5c-444e-a37c-dbe58f585d75 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.435862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.435862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.435862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.436297] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b05014f4-0d5c-444e-a37c-dbe58f585d75',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.436297] env[70535]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 883.436951] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29ee0426-6a12-4c04-9765-fa731a9837a7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.437073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.437133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.437855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.437855] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29ee0426-6a12-4c04-9765-fa731a9837a7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.438876] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.438876] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.438876] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.438876] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.438876] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.439668] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2476f5f-d3ef-49eb-bade-f2adb005ec7c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.439773] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.439840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.439995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.440075] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2476f5f-d3ef-49eb-bade-f2adb005ec7c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.441111] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.441215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.441275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.441427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.441571] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.442696] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c30db4ac-0243-4260-914e-2e6a0283c93a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.442813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.442930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.443144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.443217] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.445026] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b11bca7-ad54-4a56-a651-3a19b70ab917 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.445026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.445026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.445026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.445026] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b11bca7-ad54-4a56-a651-3a19b70ab917',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.445755] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89135034-9b45-4344-b065-0229db08f4f9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.445890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.445926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.446087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.446157] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89135034-9b45-4344-b065-0229db08f4f9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.447042] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce0ae195-bd66-418b-89e1-33b9dece1034 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.447151] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.447208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.447511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.447511] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce0ae195-bd66-418b-89e1-33b9dece1034',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.448411] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.448527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.448590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.448739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.448806] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.751640] env[70535]: INFO networking_nsxv3.common.synchronization [req-78565c69-1b5d-4252-b542-a22a9e66746a req-4cde0a63-38d1-497b-8e76-c4f977530278 tempest-ServerMetadataNegativeTestJSON-1264359968 tempest-ServerMetadataNegativeTestJSON-1264359968-project-member] Enqueued Resource ID: 137ee755-5484-45a9-a8f1-2a50747a7208 with Priority: HIGHEST for action security_group_members [ 883.753880] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137ee755-5484-45a9-a8f1-2a50747a7208 with Priority: HIGHEST for action security_group_members [ 883.753880] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-137ee755-5484-45a9-a8f1-2a50747a7208 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.753880] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.753880] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.756522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.756522] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.756522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.756522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.756522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.756522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.756522] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('137ee755-5484-45a9-a8f1-2a50747a7208',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.756522] env[70535]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 883.954135] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe09099-3626-4cb3-9710-c5c35d48d103 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.954306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.954356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.954596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.954759] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.954871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.954937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.955127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.955215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.955315] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.955404] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.977170] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.977170] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.977170] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.977170] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.980960] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.981413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.983020] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.983020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.987437] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-b05014f4-0d5c-444e-a37c-dbe58f585d75 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.988317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.990753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.990753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.990753] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.990753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.990753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.990753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.990753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.990753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.990753] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b05014f4-0d5c-444e-a37c-dbe58f585d75',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.995567] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-90c4bd0b-6551-40c3-9e23-945c4ab91af0 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.995922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.996124] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.996471] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.996760] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.997023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.997224] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.999498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.999498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.999498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.999498] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90c4bd0b-6551-40c3-9e23-945c4ab91af0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.999703] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9244c40-b3c3-42a1-af4b-33b8585c25ed taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.999703] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.999809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.001028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.001028] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.001028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.001028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.001028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.001028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.001028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.001028] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9244c40-b3c3-42a1-af4b-33b8585c25ed',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.003192] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.003624] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.004389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.004389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.004389] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.004389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.004389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.004640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.004640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.004640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.004640] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.005696] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.005877] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.005982] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.006250] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.006463] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.006877] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.006953] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.007215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.007319] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.007401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.007488] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.015568] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.015737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.015737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.016012] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.016331] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.016461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.016520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.016706] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.016787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.016968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.017146] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.019592] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b11bca7-ad54-4a56-a651-3a19b70ab917 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.019715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.019929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.020608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.020776] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.020882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.020951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.021177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.021279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.021401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.021496] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b11bca7-ad54-4a56-a651-3a19b70ab917',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.026426] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90c4bd0b-6551-40c3-9e23-945c4ab91af0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.027581] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.027581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.027581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.027891] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.027891] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.028033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.028100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.028196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.028418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.028519] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.028666] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.028762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.028827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.028970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.030701] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.030701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.030701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.030701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.030701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.030701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.030701] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.031612] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.031711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.034603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.034717] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1dcacf3-cf94-4660-82d4-dac926fd56fb is going to be deleted. [ 884.038337] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.041091] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9244c40-b3c3-42a1-af4b-33b8585c25ed',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.042761] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.044190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.044190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.044190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.051432] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2: rpc.has_security_group_logging(os_id): False [ 884.052973] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90c4bd0b-6551-40c3-9e23-945c4ab91af0: rpc.has_security_group_logging(os_id): False [ 884.056686] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f0ce39e-83c0-4345-91bb-9366dd77a60c: rpc.has_security_group_logging(os_id): False [ 884.059370] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9244c40-b3c3-42a1-af4b-33b8585c25ed: rpc.has_security_group_logging(os_id): False [ 884.096425] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.096645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.098060] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.098202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.099270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.099415] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 is going to be deleted. [ 884.100331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.100546] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.114696] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.114696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.115254] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.115254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.116066] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.116268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.118110] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.118342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.122050] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.122378] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.124597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.124597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.124597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.124597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.124988] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.125136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.125835] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.125988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.137704] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 884.138331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.138561] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c0519b9-5948-4844-8e1d-20705cb47261 is going to be deleted. [ 884.140185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.140556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.163925] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.164359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.169723] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.169839] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce0ae195-bd66-418b-89e1-33b9dece1034 is going to be deleted. [ 884.170854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.171407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.194318] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.194525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.195610] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.196175] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.200810] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 884.201564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.201848] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be deleted. [ 884.203259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.203595] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.228180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.228374] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89135034-9b45-4344-b065-0229db08f4f9 is going to be deleted. [ 884.229515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.229769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.264648] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.264916] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.279028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.279028] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 943c9a56-84a0-4361-a030-eef87cb00d31 is going to be deleted. [ 884.279028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.279028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.310831] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.311055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.350470] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.351062] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2476f5f-d3ef-49eb-bade-f2adb005ec7c is going to be deleted. [ 884.353104] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.353104] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.400022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.400022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.409241] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.409606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.429692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.429692] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c30db4ac-0243-4260-914e-2e6a0283c93a is going to be deleted. [ 884.430972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.432052] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.459543] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.494377] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b05014f4-0d5c-444e-a37c-dbe58f585d75',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.537466] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b11bca7-ad54-4a56-a651-3a19b70ab917',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.538980] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.540865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.541254] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.541384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.541430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.541625] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.542201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.542201] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed is going to be updated. [ 884.544378] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.544378] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.604789] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.604980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.609598] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.609598] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.613734] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.614237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.622255] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.622320] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29ee0426-6a12-4c04-9765-fa731a9837a7 is going to be deleted. [ 884.624069] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.627192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.649872] env[70535]: INFO networking_nsxv3.common.synchronization [req-b4ea2083-194e-44aa-84a9-da37db6f0472 req-e2aecf07-5f72-4401-98cd-c45bda295a6e tempest-VolumesAssistedSnapshotsTest-117852516 tempest-VolumesAssistedSnapshotsTest-117852516-project-member] Enqueued Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGHEST for action security_group_members [ 884.651633] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGHEST for action security_group_members [ 884.651633] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-90c4bd0b-6551-40c3-9e23-945c4ab91af0 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.651813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.651813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.652015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.653146] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.653146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.653146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.653361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.653361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.653435] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90c4bd0b-6551-40c3-9e23-945c4ab91af0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.715017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.715017] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50631980-025e-4f7c-a21a-486351e09d1f is going to be deleted. [ 884.715508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.715508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.819185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.819185] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bfef491-cf1d-478b-8711-9cea38aaf832 is going to be deleted. [ 884.819524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.820285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.842919] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.843163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.868500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.868500] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.868500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.868500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.868500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.868500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.870050] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 is going to be updated. [ 884.870050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.871882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.937852] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.937852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.950368] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.950902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.961583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.961583] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.961583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.961583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.961583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.961583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.961583] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.961583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.961583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.961583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.961583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.961583] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.961583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.961583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.962159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.962159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.962159] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 884.963552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.964033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.964283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.964548] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.964821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.965212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.967098] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.967098] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c0519b9-5948-4844-8e1d-20705cb47261" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.967098] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0fe09099-3626-4cb3-9710-c5c35d48d103: rpc.has_security_group_logging(os_id): False [ 884.969023] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.969023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.969023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.969023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.969023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.969023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bfef491-cf1d-478b-8711-9cea38aaf832" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.969023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.969777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.998376] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b05014f4-0d5c-444e-a37c-dbe58f585d75: rpc.has_security_group_logging(os_id): False [ 885.029214] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.029404] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.047665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.047799] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.047993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.048118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.048431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.048570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.048718] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137ee755-5484-45a9-a8f1-2a50747a7208 is going to be updated. [ 885.057034] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b11bca7-ad54-4a56-a651-3a19b70ab917: rpc.has_security_group_logging(os_id): False [ 885.060106] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d004720e-0079-4896-920b-7b1e57b6b7b8: rpc.has_security_group_logging(os_id): False [ 885.060400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.060400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.060400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.060400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89135034-9b45-4344-b065-0229db08f4f9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.064031] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.064031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.064031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.064031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.133451] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.134109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.157749] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.157954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.184922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.185411] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.185633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.185726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.186116] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.186224] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.186519] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 is going to be updated. [ 885.187690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.187902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.187995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.188133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-943c9a56-84a0-4361-a030-eef87cb00d31" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.188274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.188539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.188539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.188739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2476f5f-d3ef-49eb-bade-f2adb005ec7c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.190252] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.190369] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.190413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.190582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.190717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.191837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.193600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.193600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.193600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.193600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.193600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.193600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.194667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.195021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.195269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.195576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1dcacf3-cf94-4660-82d4-dac926fd56fb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.200079] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.200079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.200079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.200079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.237684] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.237684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.261525] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.262103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.262282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.262646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.263310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.266422] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed in Status: IN_PROGRESS for 2s [ 885.286095] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 in Status: IN_PROGRESS for 2s [ 885.287926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.288389] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.288534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.288630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.288939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.289073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.289212] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 is going to be updated. [ 885.290865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.291775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.291915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.293298] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.293298] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.293298] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.297158] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137ee755-5484-45a9-a8f1-2a50747a7208 in Status: IN_PROGRESS for 2s [ 885.356225] env[70535]: INFO networking_nsxv3.common.synchronization [None req-2538289e-655d-4a81-8ecb-73dabc56e70f None None] Enqueued Resource ID: fe226e65-c3c0-4f88-ae5d-05f76d062c52 with Priority: HIGHEST for action port [ 885.356817] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe226e65-c3c0-4f88-ae5d-05f76d062c52 with Priority: HIGHEST for action port [ 885.357352] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe226e65-c3c0-4f88-ae5d-05f76d062c52 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.357352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe226e65-c3c0-4f88-ae5d-05f76d062c52" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.357549] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe226e65-c3c0-4f88-ae5d-05f76d062c52" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.357638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe226e65-c3c0-4f88-ae5d-05f76d062c52" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.357725] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe226e65-c3c0-4f88-ae5d-05f76d062c52',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.361838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.363013] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.363013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.363013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.363013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.363013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.363013] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 is going to be updated. [ 885.366058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.366457] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.438710] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.439558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.440499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.440865] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.441044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.441044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.441330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.441429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.441496] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 is going to be updated. [ 885.442829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.443119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.443228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.443369] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.443619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.443708] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.443795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.443953] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29ee0426-6a12-4c04-9765-fa731a9837a7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.444903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.445184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.445294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.445468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce0ae195-bd66-418b-89e1-33b9dece1034" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.445655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.445834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.446449] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.448769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.449062] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.467719] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 885.503433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.503934] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.504064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.504133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.504359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.504450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.505108] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be updated. [ 885.508600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.508768] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.508860] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.513527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.513813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.513940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.514211] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.515103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.515103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.515240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.515337] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.515493] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 is going to be updated. [ 885.526102] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.526289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.526344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.526530] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.526680] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.546936] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 in Status: IN_PROGRESS for 2s [ 885.548210] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 in Status: IN_PROGRESS for 2s [ 885.593533] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.593533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.593533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.593533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.594367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.663034] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: IN_PROGRESS for 2s [ 885.684811] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.684811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.684811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.684811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.684811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.690012] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.690216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.690288] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.690720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.690720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.718636] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 in Status: IN_PROGRESS for 2s [ 885.740643] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: IN_PROGRESS for 2s [ 885.779141] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 885.779754] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.779902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.779989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.780187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.780545] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.808953] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: IN_PROGRESS for 2s [ 885.861516] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe226e65-c3c0-4f88-ae5d-05f76d062c52 [ 885.861742] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.862057] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.862057] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.862396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.862642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.862818] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe226e65-c3c0-4f88-ae5d-05f76d062c52 already deleted. [ 885.863088] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe226e65-c3c0-4f88-ae5d-05f76d062c52" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.103037] env[70535]: INFO networking_nsxv3.common.synchronization [req-08830869-3174-483c-96b6-bdec620d4ed7 req-23a9ca64-f699-4a70-8f51-0b07437b7de8 tempest-ServersAdminTestJSON-1221450413 tempest-ServersAdminTestJSON-1221450413-project-member] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 887.105373] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 887.105373] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.105373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.105373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.105373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.105373] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.105995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.105995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.105995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.105995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.105995] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.281668] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed in Status: SUCCESS [ 887.281947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.303071] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 in Status: SUCCESS [ 887.303071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.308294] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 137ee755-5484-45a9-a8f1-2a50747a7208 in Status: SUCCESS [ 887.308486] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 137ee755-5484-45a9-a8f1-2a50747a7208 deletion is rescheduled due to dependency. [ 887.308610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.406667] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-39 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.406904] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.407103] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.407431] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.407706] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.409111] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.409281] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.409559] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.409716] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.409940] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 887.410088] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.410225] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.410371] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.410491] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 887.410601] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.410754] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.431918] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.432101] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 887.432192] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.432365] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-39" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.432728] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-75f970bb-1bbc-4b2d-95bf-06bb2619dbb7 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.432919] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-75f970bb-1bbc-4b2d-95bf-06bb2619dbb7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.433070] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-75f970bb-1bbc-4b2d-95bf-06bb2619dbb7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.433430] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-75f970bb-1bbc-4b2d-95bf-06bb2619dbb7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.433603] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75f970bb-1bbc-4b2d-95bf-06bb2619dbb7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.484546] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 887.484816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.569443] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 in Status: SUCCESS [ 887.569443] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.569443] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 in Status: SUCCESS [ 887.569443] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.608531] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.674232] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: SUCCESS [ 887.674232] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.730829] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 in Status: SUCCESS [ 887.730829] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 deletion is rescheduled due to dependency. [ 887.730829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.760907] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: SUCCESS [ 887.760907] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.826171] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 887.826704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.937790] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.938171] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.938333] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.938558] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.938728] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.938893] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 75f970bb-1bbc-4b2d-95bf-06bb2619dbb7 not found, creating... [ 887.939234] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.939460] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.939605] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.939892] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.940074] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.940449] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.940726] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.940876] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.941311] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.941417] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.941573] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 75f970bb-1bbc-4b2d-95bf-06bb2619dbb7 is going to be created. [ 887.970623] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.970623] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.970623] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.970623] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.971427] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.973272] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-75f970bb-1bbc-4b2d-95bf-06bb2619dbb7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.111364] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.224759] env[70535]: INFO networking_nsxv3.common.synchronization [None req-e7bb148e-9343-4ec4-b0d9-f2865ce2c842 None None] Enqueued Resource ID: 13ef247c-a40d-4a03-9bfc-3623ffb2952a with Priority: HIGHEST for action port [ 888.225566] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13ef247c-a40d-4a03-9bfc-3623ffb2952a with Priority: HIGHEST for action port [ 888.226019] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-13ef247c-a40d-4a03-9bfc-3623ffb2952a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.226218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13ef247c-a40d-4a03-9bfc-3623ffb2952a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.226324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13ef247c-a40d-4a03-9bfc-3623ffb2952a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.226692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13ef247c-a40d-4a03-9bfc-3623ffb2952a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.226786] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13ef247c-a40d-4a03-9bfc-3623ffb2952a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.613897] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.614125] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.614176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.614388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.614481] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.614582] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be updated. [ 888.648258] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.648579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.648579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.648700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.648844] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.658849] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: IN_PROGRESS for 2s [ 888.663495] env[70535]: INFO networking_nsxv3.common.synchronization [req-08830869-3174-483c-96b6-bdec620d4ed7 req-e050eace-10f2-4528-827f-cbaf1ad55698 service nova] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_rules [ 888.663677] env[70535]: INFO networking_nsxv3.common.synchronization [req-08830869-3174-483c-96b6-bdec620d4ed7 req-e050eace-10f2-4528-827f-cbaf1ad55698 service nova] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 888.663819] env[70535]: INFO networking_nsxv3.common.synchronization [req-08830869-3174-483c-96b6-bdec620d4ed7 req-e050eace-10f2-4528-827f-cbaf1ad55698 service nova] Enqueued Resource ID: 75f970bb-1bbc-4b2d-95bf-06bb2619dbb7 with Priority: HIGHEST for action port [ 888.664334] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_rules [ 888.664471] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 888.664574] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f970bb-1bbc-4b2d-95bf-06bb2619dbb7 with Priority: HIGHEST for action port [ 888.664860] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.665210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.665394] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.665587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.665682] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.667796] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.667796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.667796] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-75f970bb-1bbc-4b2d-95bf-06bb2619dbb7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.668146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75f970bb-1bbc-4b2d-95bf-06bb2619dbb7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.668146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75f970bb-1bbc-4b2d-95bf-06bb2619dbb7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.668234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75f970bb-1bbc-4b2d-95bf-06bb2619dbb7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.668330] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75f970bb-1bbc-4b2d-95bf-06bb2619dbb7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.730289] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13ef247c-a40d-4a03-9bfc-3623ffb2952a [ 888.730676] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.730902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.731060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.731403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.731581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.731756] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13ef247c-a40d-4a03-9bfc-3623ffb2952a already deleted. [ 888.732647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13ef247c-a40d-4a03-9bfc-3623ffb2952a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.170920] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.170920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.170920] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75f970bb-1bbc-4b2d-95bf-06bb2619dbb7 with status ACTIVE [ 889.171604] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.171604] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.171604] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.171604] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.171604] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.171812] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.172545] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.172545] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.172545] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.172545] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.172545] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.173743] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.173743] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.173743] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.173743] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.173743] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75f970bb-1bbc-4b2d-95bf-06bb2619dbb7 is going to be updated. [ 889.211553] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.211553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.211861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.211861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.211952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.212540] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75f970bb-1bbc-4b2d-95bf-06bb2619dbb7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.964626] env[70535]: INFO networking_nsxv3.common.synchronization [req-216b8d50-e364-424e-893a-f2310cc7d27d req-6b6d42e4-49c9-44e7-87ce-326401e958e4 tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae with Priority: HIGHEST for action security_group_members [ 889.965479] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae with Priority: HIGHEST for action security_group_members [ 889.966077] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ac4f9b-8f0d-49c2-916e-fc155db340ae taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.966633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.966827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.967411] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.967711] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.967936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.968146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.968807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.968807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.968968] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ac4f9b-8f0d-49c2-916e-fc155db340ae',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.413611] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.413936] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.413936] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.414217] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.414476] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.414646] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.414832] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.415195] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.415433] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.415674] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.415796] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.416128] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.416293] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.416418] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.416530] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.416677] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.437444] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.437444] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 890.437444] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.437444] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.437444] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-2f285a54-f690-457a-bf32-6d73d6d1ead9 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.437444] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-2f285a54-f690-457a-bf32-6d73d6d1ead9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.437444] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-2f285a54-f690-457a-bf32-6d73d6d1ead9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.438305] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-2f285a54-f690-457a-bf32-6d73d6d1ead9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.438305] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f285a54-f690-457a-bf32-6d73d6d1ead9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.472193] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.472414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.472414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.472777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.472777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.473018] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.473215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.473215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.473368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.473368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.473518] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae already deleted. [ 890.473602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.670076] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 890.670301] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.670940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.671045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.671232] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.671347] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.671411] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.671567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.671646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.671743] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.940216] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.940458] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.940589] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.940884] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.941055] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.941220] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 2f285a54-f690-457a-bf32-6d73d6d1ead9 not found, creating... [ 890.941480] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.941639] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.941758] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.941980] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.942137] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.942417] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.943049] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.943049] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.943049] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.943049] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.943356] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 2f285a54-f690-457a-bf32-6d73d6d1ead9 is going to be created. [ 890.965997] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.966205] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.966383] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.966680] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.966916] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.967172] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-2f285a54-f690-457a-bf32-6d73d6d1ead9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.174374] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.676117] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.709607] env[70535]: INFO networking_nsxv3.common.synchronization [req-216b8d50-e364-424e-893a-f2310cc7d27d req-30db8e7a-11fb-49d9-a1b3-16749eefcc37 service nova] Enqueued Resource ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae with Priority: HIGHEST for action security_group_rules [ 891.709702] env[70535]: INFO networking_nsxv3.common.synchronization [req-216b8d50-e364-424e-893a-f2310cc7d27d req-30db8e7a-11fb-49d9-a1b3-16749eefcc37 service nova] Enqueued Resource ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae with Priority: HIGHEST for action security_group_members [ 891.709839] env[70535]: INFO networking_nsxv3.common.synchronization [req-216b8d50-e364-424e-893a-f2310cc7d27d req-30db8e7a-11fb-49d9-a1b3-16749eefcc37 service nova] Enqueued Resource ID: 2f285a54-f690-457a-bf32-6d73d6d1ead9 with Priority: HIGHEST for action port [ 891.710511] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae with Priority: HIGHEST for action security_group_rules [ 891.710511] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae with Priority: HIGHEST for action security_group_members [ 891.710511] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f285a54-f690-457a-bf32-6d73d6d1ead9 with Priority: HIGHEST for action port [ 891.711027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.711027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.711027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.711799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.711799] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ac4f9b-8f0d-49c2-916e-fc155db340ae',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.712201] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ac4f9b-8f0d-49c2-916e-fc155db340ae taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.712309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.712372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.712546] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.712697] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.712867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.712867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.713020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.713103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.713193] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ac4f9b-8f0d-49c2-916e-fc155db340ae',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.713966] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f285a54-f690-457a-bf32-6d73d6d1ead9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.714078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f285a54-f690-457a-bf32-6d73d6d1ead9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.714152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f285a54-f690-457a-bf32-6d73d6d1ead9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.714349] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f285a54-f690-457a-bf32-6d73d6d1ead9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.714349] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f285a54-f690-457a-bf32-6d73d6d1ead9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.178490] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.178490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.178490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.178824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.178824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.178824] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be updated. [ 892.211270] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.211422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.211513] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.211713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.211864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.215641] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ac4f9b-8f0d-49c2-916e-fc155db340ae taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.215804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.215955] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ac4f9b-8f0d-49c2-916e-fc155db340ae',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.216906] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f285a54-f690-457a-bf32-6d73d6d1ead9 with status ACTIVE [ 892.217149] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.217279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.217344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.217519] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.217687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.217849] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.217944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.217944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.218121] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.218198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.218379] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.218497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.218563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.218697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.218775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.218849] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f285a54-f690-457a-bf32-6d73d6d1ead9 is going to be updated. [ 892.221357] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: IN_PROGRESS for 2s [ 892.242636] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.242636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.242636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.242842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.242966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.243159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f285a54-f690-457a-bf32-6d73d6d1ead9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.721075] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ac4f9b-8f0d-49c2-916e-fc155db340ae',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.225826] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.225826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.225826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.225826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.225826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.225826] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae is going to be created. [ 893.252264] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.252422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.252476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.252699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.252893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.263923] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae in Status: UNINITIALIZED for 2s [ 894.233338] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 894.233338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.233338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.233338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.233338] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.233338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.233338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.233338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.233338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.233338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.233338] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.736042] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.736226] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.736305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.736517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.736685] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.736782] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.736840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.737038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.737109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.737197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.737364] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.737459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.737520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.737694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.737867] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.737917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.737961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.739628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.739628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.739628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.739628] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.242910] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f32aa9cd-fe8f-4b69-8037-59fa1cf6570c: rpc.has_security_group_logging(os_id): False [ 895.259544] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.259719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.259799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.260058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.273843] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae in Status: SUCCESS [ 895.274095] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.274360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.274583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.274801] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.274920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.275064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.275221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.275312] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.275398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.275493] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ac4f9b-8f0d-49c2-916e-fc155db340ae',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.285789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.286193] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.286269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.286335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.286529] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.286611] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.286806] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.286906] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.286970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.287153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.287234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.287430] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.287517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.287581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.287721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.287858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.287905] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be updated. [ 895.350783] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.350944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.351028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.351253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.352642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.364578] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: IN_PROGRESS for 2s [ 895.778258] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ac4f9b-8f0d-49c2-916e-fc155db340ae',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.280396] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ac4f9b-8f0d-49c2-916e-fc155db340ae: rpc.has_security_group_logging(os_id): False [ 896.304351] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.304577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.304577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.305479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.305479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.305479] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.305479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.305479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.305793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.305793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.305793] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae is going to be created. [ 896.371408] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.371656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.371714] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.372045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.372332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.386165] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae in Status: IN_PROGRESS for 2s [ 896.711489] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 896.711489] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 897.379333] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 897.379628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.400609] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae in Status: SUCCESS [ 898.400882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.712665] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 901.713053] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 906.714225] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 906.714551] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 907.843124] env[70535]: INFO networking_nsxv3.common.synchronization [None req-3404d733-9f57-4751-b7e9-56965cd09f34 None None] Enqueued Resource ID: 2eeecc69-ea67-4b13-90d6-a53e9879e7e8 with Priority: HIGHEST for action port [ 907.843662] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eeecc69-ea67-4b13-90d6-a53e9879e7e8 with Priority: HIGHEST for action port [ 907.844026] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-2eeecc69-ea67-4b13-90d6-a53e9879e7e8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.844154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2eeecc69-ea67-4b13-90d6-a53e9879e7e8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.844351] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2eeecc69-ea67-4b13-90d6-a53e9879e7e8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.844528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2eeecc69-ea67-4b13-90d6-a53e9879e7e8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.844616] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eeecc69-ea67-4b13-90d6-a53e9879e7e8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.347030] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2eeecc69-ea67-4b13-90d6-a53e9879e7e8 [ 908.347030] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.347030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.347030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.347391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.347391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.347391] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2eeecc69-ea67-4b13-90d6-a53e9879e7e8 already deleted. [ 908.347512] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2eeecc69-ea67-4b13-90d6-a53e9879e7e8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.722447] env[70535]: INFO networking_nsxv3.common.synchronization [None req-b2b28190-bf31-4864-b7d8-8f99197e630f None None] Enqueued Resource ID: 76be4be2-60d4-4e6b-95bf-f5eafe1a742e with Priority: HIGHEST for action port [ 909.723056] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76be4be2-60d4-4e6b-95bf-f5eafe1a742e with Priority: HIGHEST for action port [ 909.723457] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-76be4be2-60d4-4e6b-95bf-f5eafe1a742e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.723588] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76be4be2-60d4-4e6b-95bf-f5eafe1a742e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.723655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76be4be2-60d4-4e6b-95bf-f5eafe1a742e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.724025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76be4be2-60d4-4e6b-95bf-f5eafe1a742e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.724137] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76be4be2-60d4-4e6b-95bf-f5eafe1a742e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.229428] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76be4be2-60d4-4e6b-95bf-f5eafe1a742e [ 910.229656] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.229816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.229861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.230081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.230215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.230267] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76be4be2-60d4-4e6b-95bf-f5eafe1a742e already deleted. [ 910.230432] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76be4be2-60d4-4e6b-95bf-f5eafe1a742e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.527187] env[70535]: INFO networking_nsxv3.common.synchronization [None req-80e7992d-2165-4b04-af98-857f2a555db5 None None] Enqueued Resource ID: c71ca722-679f-447c-80ce-e5b45396edad with Priority: HIGHEST for action port [ 910.527187] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c71ca722-679f-447c-80ce-e5b45396edad with Priority: HIGHEST for action port [ 910.527187] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-c71ca722-679f-447c-80ce-e5b45396edad taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.527187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c71ca722-679f-447c-80ce-e5b45396edad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.527187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c71ca722-679f-447c-80ce-e5b45396edad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.527187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c71ca722-679f-447c-80ce-e5b45396edad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.527187] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c71ca722-679f-447c-80ce-e5b45396edad',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.030401] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c71ca722-679f-447c-80ce-e5b45396edad [ 911.030401] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.030401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.030401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.030401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.030401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.030401] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c71ca722-679f-447c-80ce-e5b45396edad already deleted. [ 911.030401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c71ca722-679f-447c-80ce-e5b45396edad" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.478887] env[70535]: INFO networking_nsxv3.common.synchronization [req-bb7b3940-5ce6-41ed-a8ab-cd46ebf990c7 req-5ad2d840-a6c1-46f0-be43-baa4c92daad8 tempest-ServersTestManualDisk-419272698 tempest-ServersTestManualDisk-419272698-project-member] Enqueued Resource ID: f932dfa4-49e7-4477-968f-48bf223104fa with Priority: HIGHEST for action security_group_members [ 912.479918] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f932dfa4-49e7-4477-968f-48bf223104fa with Priority: HIGHEST for action security_group_members [ 912.479918] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f932dfa4-49e7-4477-968f-48bf223104fa taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.479918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.479918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.482143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.482143] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.482143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.482143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.482143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.482143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.485030] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f932dfa4-49e7-4477-968f-48bf223104fa',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.916601] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.918021] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-588" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.918021] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-588" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.918021] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-588" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.918021] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.918021] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.918336] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.918603] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.918835] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.919234] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 912.919418] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.919631] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.919830] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.920038] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 912.920200] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.920405] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.942825] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.943078] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 912.943270] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.943483] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-588" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.943876] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-54037519-bdd9-4b0c-bcf9-3d712bd1f42f taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.944115] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-54037519-bdd9-4b0c-bcf9-3d712bd1f42f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.944281] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-54037519-bdd9-4b0c-bcf9-3d712bd1f42f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.944673] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-54037519-bdd9-4b0c-bcf9-3d712bd1f42f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.944849] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54037519-bdd9-4b0c-bcf9-3d712bd1f42f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.987283] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.987651] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.987651] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.988321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.988321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.988321] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.988321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.988321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.988523] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.988523] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.988633] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f932dfa4-49e7-4477-968f-48bf223104fa already deleted. [ 912.988691] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.248075] env[70535]: INFO networking_nsxv3.common.synchronization [None req-87637ab6-df4a-4003-b992-15f7e823e649 None None] Enqueued Resource ID: 78cf1e6d-1947-4808-8e84-9b552d123c95 with Priority: HIGHEST for action port [ 913.249050] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf1e6d-1947-4808-8e84-9b552d123c95 with Priority: HIGHEST for action port [ 913.249670] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-78cf1e6d-1947-4808-8e84-9b552d123c95 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.249888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78cf1e6d-1947-4808-8e84-9b552d123c95" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.249888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78cf1e6d-1947-4808-8e84-9b552d123c95" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.250157] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78cf1e6d-1947-4808-8e84-9b552d123c95" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.250243] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78cf1e6d-1947-4808-8e84-9b552d123c95',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.449112] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.449898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.449898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.450108] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.450383] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.450661] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 54037519-bdd9-4b0c-bcf9-3d712bd1f42f not found, creating... [ 913.451125] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.451423] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.451649] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.452047] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.452309] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.452808] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.453123] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.453349] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.453694] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.453937] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.454208] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 54037519-bdd9-4b0c-bcf9-3d712bd1f42f is going to be created. [ 913.479770] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.480238] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.480238] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.480414] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.480653] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.480898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-54037519-bdd9-4b0c-bcf9-3d712bd1f42f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.752130] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78cf1e6d-1947-4808-8e84-9b552d123c95 [ 913.752348] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.752491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.752559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.752776] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.752871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.752992] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78cf1e6d-1947-4808-8e84-9b552d123c95 already deleted. [ 913.753101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78cf1e6d-1947-4808-8e84-9b552d123c95" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.311827] env[70535]: INFO networking_nsxv3.common.synchronization [req-bb7b3940-5ce6-41ed-a8ab-cd46ebf990c7 req-8ccfb252-e155-4588-9db0-26e858a97c92 service nova] Enqueued Resource ID: f932dfa4-49e7-4477-968f-48bf223104fa with Priority: HIGHEST for action security_group_rules [ 914.311827] env[70535]: INFO networking_nsxv3.common.synchronization [req-bb7b3940-5ce6-41ed-a8ab-cd46ebf990c7 req-8ccfb252-e155-4588-9db0-26e858a97c92 service nova] Enqueued Resource ID: f932dfa4-49e7-4477-968f-48bf223104fa with Priority: HIGHEST for action security_group_members [ 914.311827] env[70535]: INFO networking_nsxv3.common.synchronization [req-bb7b3940-5ce6-41ed-a8ab-cd46ebf990c7 req-8ccfb252-e155-4588-9db0-26e858a97c92 service nova] Enqueued Resource ID: 54037519-bdd9-4b0c-bcf9-3d712bd1f42f with Priority: HIGHEST for action port [ 914.311827] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f932dfa4-49e7-4477-968f-48bf223104fa with Priority: HIGHEST for action security_group_rules [ 914.311827] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f932dfa4-49e7-4477-968f-48bf223104fa with Priority: HIGHEST for action security_group_members [ 914.311827] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54037519-bdd9-4b0c-bcf9-3d712bd1f42f with Priority: HIGHEST for action port [ 914.311827] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f932dfa4-49e7-4477-968f-48bf223104fa taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.311827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.311827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.311827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.311827] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f932dfa4-49e7-4477-968f-48bf223104fa',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.312376] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f932dfa4-49e7-4477-968f-48bf223104fa taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.312376] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.312376] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.312596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.312748] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.312893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.312945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.314033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.314033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.314033] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f932dfa4-49e7-4477-968f-48bf223104fa',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.314438] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-54037519-bdd9-4b0c-bcf9-3d712bd1f42f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.314580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54037519-bdd9-4b0c-bcf9-3d712bd1f42f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.314667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54037519-bdd9-4b0c-bcf9-3d712bd1f42f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.314926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54037519-bdd9-4b0c-bcf9-3d712bd1f42f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.314926] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54037519-bdd9-4b0c-bcf9-3d712bd1f42f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.818092] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f932dfa4-49e7-4477-968f-48bf223104fa taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.818092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.818092] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f932dfa4-49e7-4477-968f-48bf223104fa',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.818607] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54037519-bdd9-4b0c-bcf9-3d712bd1f42f with status ACTIVE [ 914.818607] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.818693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.818726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.818933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.819867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.819867] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.819867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.819867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.819867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.819867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.820983] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.821118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.821118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.821287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.821374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.821485] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54037519-bdd9-4b0c-bcf9-3d712bd1f42f is going to be updated. [ 914.846445] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.846445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.846445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.846676] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.846813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.846974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54037519-bdd9-4b0c-bcf9-3d712bd1f42f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.323676] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f932dfa4-49e7-4477-968f-48bf223104fa',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.827753] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.827753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.827753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.827753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.827753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.828695] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f932dfa4-49e7-4477-968f-48bf223104fa is going to be created. [ 915.853218] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.853505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.853589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.853818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.853987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.863263] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f932dfa4-49e7-4477-968f-48bf223104fa in Status: UNINITIALIZED for 2s [ 917.108678] env[70535]: INFO networking_nsxv3.common.synchronization [req-1a8c28fb-a467-4b08-89ab-7ecc3c93de76 req-dfde9c18-dbcb-4771-bd61-c47e106e1940 tempest-ServersTestBootFromVolume-979772703 tempest-ServersTestBootFromVolume-979772703-project-member] Enqueued Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGHEST for action security_group_members [ 917.109223] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGHEST for action security_group_members [ 917.109928] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b11bca7-ad54-4a56-a651-3a19b70ab917 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.110841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.110841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.110982] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.111072] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.111253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.111317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.111484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.111669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.111669] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b11bca7-ad54-4a56-a651-3a19b70ab917',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.433457] env[70535]: INFO networking_nsxv3.common.synchronization [req-b6676927-e036-4aa9-841b-f444739156ba req-1d1b6459-c8bb-4ce3-a4ec-aceea0ed016a tempest-ServersWithSpecificFlavorTestJSON-86157586 tempest-ServersWithSpecificFlavorTestJSON-86157586-project-member] Enqueued Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_members [ 917.433968] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_members [ 917.434294] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b3e2660-4c57-4d95-a486-449e2bf37488 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.434421] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.434492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.434697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.434854] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.434953] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.435650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.436246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.436246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.436246] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.617031] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.617031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.617031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.617031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.617031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.617031] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.617031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.617031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.617031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.617031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.617031] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 is going to be updated. [ 917.647027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.647027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.647027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.647027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.647027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.655728] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 in Status: IN_PROGRESS for 2s [ 917.877026] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f932dfa4-49e7-4477-968f-48bf223104fa in Status: SUCCESS [ 917.877026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.877026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.877026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.877026] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.877026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.877026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.877026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.877026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.877026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.877026] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f932dfa4-49e7-4477-968f-48bf223104fa',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.915897] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-138 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.916402] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-138" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.916584] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-138" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.917472] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-138" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.917886] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.918805] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.918805] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.918805] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.918998] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.919179] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.919286] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.919403] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.919519] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.919673] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.919812] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.920501] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.938905] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.939111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.939202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.939434] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.939544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.939728] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.939835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.939891] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.940152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.940254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.940362] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 is going to be deleted. [ 917.943274] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.943530] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 917.944190] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.944190] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-138" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.944190] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-c1dd218b-31ce-4ef7-b221-5321e5e61e95 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.944456] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-c1dd218b-31ce-4ef7-b221-5321e5e61e95" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.944503] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-c1dd218b-31ce-4ef7-b221-5321e5e61e95" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.944906] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-c1dd218b-31ce-4ef7-b221-5321e5e61e95" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.945064] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1dd218b-31ce-4ef7-b221-5321e5e61e95',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.982317] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.983988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.983988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.983988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.983988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.983988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.080493] env[70535]: INFO networking_nsxv3.common.synchronization [req-af41b610-194c-452f-80b6-322a61e9da75 req-7ef43c98-5081-4a1c-a499-d2b79643b3de tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 with Priority: HIGHEST for action security_group_members [ 918.080709] env[70535]: INFO networking_nsxv3.common.synchronization [req-af41b610-194c-452f-80b6-322a61e9da75 req-7ef43c98-5081-4a1c-a499-d2b79643b3de tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGHEST for action security_group_members [ 918.080886] env[70535]: INFO networking_nsxv3.common.synchronization [req-af41b610-194c-452f-80b6-322a61e9da75 req-7ef43c98-5081-4a1c-a499-d2b79643b3de tempest-SecurityGroupsTestJSON-1072958635 tempest-SecurityGroupsTestJSON-1072958635-project-member] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 918.081442] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 with Priority: HIGHEST for action security_group_members [ 918.081839] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGHEST for action security_group_members [ 918.081839] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGHEST for action security_group_members [ 918.082469] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.082694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.082746] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.082953] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.083134] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.083260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.083348] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.083575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.083720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.083903] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.085537] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe09099-3626-4cb3-9710-c5c35d48d103 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.085655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.085655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.085828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.086016] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.086108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.086150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.086718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.086718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.086718] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.087753] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.089846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.089846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.089846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.089846] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.089846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.089846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.089846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.089846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.089846] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.384298] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f932dfa4-49e7-4477-968f-48bf223104fa',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.449106] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.449384] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.449888] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.450724] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.450724] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.450724] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port c1dd218b-31ce-4ef7-b221-5321e5e61e95 not found, creating... [ 918.451030] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.451118] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.451258] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.451547] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.451750] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.452588] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.452866] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.453114] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.453551] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.453887] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.454109] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: c1dd218b-31ce-4ef7-b221-5321e5e61e95 is going to be created. [ 918.476906] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.477133] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.477258] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.477535] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.477762] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.478018] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-c1dd218b-31ce-4ef7-b221-5321e5e61e95" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.590541] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.590736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.590807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.591046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.592371] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.593077] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.593305] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.593409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.617301] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.617615] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.617785] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.617832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.618082] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.618188] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.618286] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 is going to be updated. [ 918.619395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.619577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.619665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.620022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.620151] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.620230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.620394] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.620467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.620556] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 is going to be updated. [ 918.621596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.621806] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.621899] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.622327] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.622519] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.622600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.622764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.622852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.623135] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be updated. [ 918.670733] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.670986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.671055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.671281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.671558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.673535] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.673669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.673765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.673972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.674150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.675970] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.676117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.676167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.676383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.676437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.688409] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: IN_PROGRESS for 2s [ 918.689606] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: IN_PROGRESS for 2s [ 918.690658] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 in Status: IN_PROGRESS for 2s [ 918.888039] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f932dfa4-49e7-4477-968f-48bf223104fa: rpc.has_security_group_logging(os_id): False [ 918.911257] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.911462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.911462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.911737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.911834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.912107] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.912216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.912282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.912450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.912518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.912652] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f932dfa4-49e7-4477-968f-48bf223104fa is going to be created. [ 918.983773] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.983978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.983978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.984268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.984458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.003214] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f932dfa4-49e7-4477-968f-48bf223104fa in Status: IN_PROGRESS for 2s [ 919.429263] env[70535]: INFO networking_nsxv3.common.synchronization [req-b6676927-e036-4aa9-841b-f444739156ba req-02fb75ae-765d-4cb3-b05e-4842b484a1b1 service nova] Enqueued Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_rules [ 919.429633] env[70535]: INFO networking_nsxv3.common.synchronization [req-b6676927-e036-4aa9-841b-f444739156ba req-02fb75ae-765d-4cb3-b05e-4842b484a1b1 service nova] Enqueued Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_members [ 919.429633] env[70535]: INFO networking_nsxv3.common.synchronization [req-b6676927-e036-4aa9-841b-f444739156ba req-02fb75ae-765d-4cb3-b05e-4842b484a1b1 service nova] Enqueued Resource ID: c1dd218b-31ce-4ef7-b221-5321e5e61e95 with Priority: HIGHEST for action port [ 919.430164] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_rules [ 919.430313] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_members [ 919.430442] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1dd218b-31ce-4ef7-b221-5321e5e61e95 with Priority: HIGHEST for action port [ 919.430753] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b3e2660-4c57-4d95-a486-449e2bf37488 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.430902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.430963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.433271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.433438] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.434554] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b3e2660-4c57-4d95-a486-449e2bf37488 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.434730] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.434847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.436123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.436347] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.436498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.436580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.436764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.436878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.436970] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.438323] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1dd218b-31ce-4ef7-b221-5321e5e61e95 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.438323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1dd218b-31ce-4ef7-b221-5321e5e61e95" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.438323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1dd218b-31ce-4ef7-b221-5321e5e61e95" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.438323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1dd218b-31ce-4ef7-b221-5321e5e61e95" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.438323] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1dd218b-31ce-4ef7-b221-5321e5e61e95',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.668716] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 in Status: SUCCESS [ 919.668716] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 deletion is rescheduled due to dependency. [ 919.668716] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.944027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b3e2660-4c57-4d95-a486-449e2bf37488 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.944027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.944027] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1dd218b-31ce-4ef7-b221-5321e5e61e95 with status ACTIVE [ 919.944027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.944027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.944027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.944027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.944027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.944027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.944027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.944027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.944027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.944027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.944027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.944601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.944601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.944601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.944601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.944601] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1dd218b-31ce-4ef7-b221-5321e5e61e95 is going to be updated. [ 919.945980] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.970897] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.970897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.971086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.971183] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.971325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.971485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1dd218b-31ce-4ef7-b221-5321e5e61e95" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.120726] env[70535]: INFO networking_nsxv3.common.synchronization [req-57e39d67-d7f8-4e95-8afa-fdf5650befc6 req-a27ecd95-cb99-4db9-badb-7608cf0b99f2 tempest-MultipleCreateTestJSON-1547146489 tempest-MultipleCreateTestJSON-1547146489-project-member] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 920.121361] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 920.121710] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.121839] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.121906] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.122196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.122357] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.122471] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.122535] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.122686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.122770] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.122863] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.449405] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.519024] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-489 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.519024] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.519024] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.519024] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.519476] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.519900] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.520192] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.520540] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.520815] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.521144] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.521561] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.521789] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.522078] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.523412] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.523412] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.523412] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.542106] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.542330] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 920.542491] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.542760] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.543166] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-3cf9caca-dcb6-4168-91e3-b29f983468e3 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.543354] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-3cf9caca-dcb6-4168-91e3-b29f983468e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.543485] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-3cf9caca-dcb6-4168-91e3-b29f983468e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.545266] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-3cf9caca-dcb6-4168-91e3-b29f983468e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.545523] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cf9caca-dcb6-4168-91e3-b29f983468e3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.626999] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.627171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.627226] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.627462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.627549] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.627764] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.627868] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.627920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.628085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.628152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.628252] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 already deleted. [ 920.628325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.703091] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 in Status: SUCCESS [ 920.703193] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 deletion is rescheduled due to dependency. [ 920.703271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.704027] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 in Status: SUCCESS [ 920.704170] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 deletion is rescheduled due to dependency. [ 920.704275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.704883] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 in Status: SUCCESS [ 920.705037] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 deletion is rescheduled due to dependency. [ 920.705135] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.952767] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.952767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.952767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.952767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.952767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.952767] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 is going to be created. [ 920.975326] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.975522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.975566] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.975765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.975927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.988443] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 in Status: UNINITIALIZED for 2s [ 921.014971] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f932dfa4-49e7-4477-968f-48bf223104fa in Status: SUCCESS [ 921.015124] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.047629] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.047896] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.048060] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.048381] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.048583] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.048777] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 3cf9caca-dcb6-4168-91e3-b29f983468e3 not found, creating... [ 921.049091] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.049268] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.049407] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.049670] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.049815] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.050150] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.050317] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.050505] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.050755] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.051054] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.052200] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 3cf9caca-dcb6-4168-91e3-b29f983468e3 is going to be created. [ 921.073446] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.073652] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.073780] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.075164] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.075164] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.075164] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-3cf9caca-dcb6-4168-91e3-b29f983468e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.782331] env[70535]: INFO networking_nsxv3.common.synchronization [req-57e39d67-d7f8-4e95-8afa-fdf5650befc6 req-d6749748-7946-412d-964b-b70a881fed26 service nova] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_rules [ 921.782604] env[70535]: INFO networking_nsxv3.common.synchronization [req-57e39d67-d7f8-4e95-8afa-fdf5650befc6 req-d6749748-7946-412d-964b-b70a881fed26 service nova] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 921.782696] env[70535]: INFO networking_nsxv3.common.synchronization [req-57e39d67-d7f8-4e95-8afa-fdf5650befc6 req-d6749748-7946-412d-964b-b70a881fed26 service nova] Enqueued Resource ID: 3cf9caca-dcb6-4168-91e3-b29f983468e3 with Priority: HIGHEST for action port [ 921.783266] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_rules [ 921.783452] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 921.783574] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf9caca-dcb6-4168-91e3-b29f983468e3 with Priority: HIGHEST for action port [ 921.783878] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.784034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.784117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.784426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.784532] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.789509] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.789509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.789509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.789509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.789509] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.789509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.789509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.789509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.789509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.789509] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.789509] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cf9caca-dcb6-4168-91e3-b29f983468e3 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.789509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cf9caca-dcb6-4168-91e3-b29f983468e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.789509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cf9caca-dcb6-4168-91e3-b29f983468e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.789509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cf9caca-dcb6-4168-91e3-b29f983468e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.789509] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cf9caca-dcb6-4168-91e3-b29f983468e3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.290884] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.292874] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.292874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.292874] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cf9caca-dcb6-4168-91e3-b29f983468e3 with status ACTIVE [ 922.293064] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.293262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.293262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.293542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.293699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.293915] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.294134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.294240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.294416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.294502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.294689] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.294785] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.294849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.294992] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.295152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.295265] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cf9caca-dcb6-4168-91e3-b29f983468e3 is going to be updated. [ 922.319630] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.319630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.319630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.319630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.319630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.319630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cf9caca-dcb6-4168-91e3-b29f983468e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.797382] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.000265] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 in Status: SUCCESS [ 923.000265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.000265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.000265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.000446] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.000517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.001095] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.001095] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.001095] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.001095] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.001095] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.300476] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.303971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.303971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.303971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.303971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.303971] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be created. [ 923.331675] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.331675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.331675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.331675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.331675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.341499] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: UNINITIALIZED for 2s [ 923.503689] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.009683] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b3e2660-4c57-4d95-a486-449e2bf37488: rpc.has_security_group_logging(os_id): False [ 924.031089] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.031281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.031281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.031508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.031599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.031853] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.032017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.032077] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.032273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.032352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.032438] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 is going to be created. [ 924.105022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.105022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.120883] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 in Status: IN_PROGRESS for 2s [ 925.353167] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 925.353863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.353863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.353863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.354106] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.354187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.354233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.354388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.354955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.354955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.354955] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.859401] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.859655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.859655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.860041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.860298] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.860467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.860657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.860766] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.860907] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.861095] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.861296] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.861426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.861525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.861761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.861990] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.862155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.862326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.862580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.862727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.862886] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.866248] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.989469] env[70535]: INFO networking_nsxv3.common.synchronization [req-4688abb9-0a99-406e-a391-27f619459333 req-4955d2fd-f74b-4102-9fc9-b87b1f1a742b tempest-ServersAdminTestJSON-1221450413 tempest-ServersAdminTestJSON-1221450413-project-member] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 925.990055] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 925.992962] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.992962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.992962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.992962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.992962] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.992962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.992962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.992962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.992962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.992962] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.136993] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 in Status: SUCCESS [ 926.137377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.370087] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec7c706b-a1b7-4402-b5c2-6e8302636c80: rpc.has_security_group_logging(os_id): False [ 926.393211] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.393518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.393648] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.394364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.394706] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.394932] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.395167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.395306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.395592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.397391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.397391] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.397391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.397391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.397391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.397391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.397391] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.397946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.397946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.397946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.397946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.398327] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be created. [ 926.489299] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.489551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.489775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.489946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.490294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.497266] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.504956] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: IN_PROGRESS for 2s [ 926.999803] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.291063] env[70535]: INFO networking_nsxv3.common.synchronization [req-57e39d67-d7f8-4e95-8afa-fdf5650befc6 req-b94150ca-8f13-40cf-9016-f1642d13c66e tempest-MultipleCreateTestJSON-1547146489 tempest-MultipleCreateTestJSON-1547146489-project-member] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 927.293761] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 927.293761] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.293761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.293761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.293761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.293761] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.293761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.293761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.293761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.293761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.294561] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.502336] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.502718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.502794] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.503058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.503161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.503281] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be updated. [ 927.556569] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.556728] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.557760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.557760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.557760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.572087] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: IN_PROGRESS for 2s [ 927.798626] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.860640] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-489 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.860857] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.862063] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.862063] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.862063] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.862063] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.862063] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.862063] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.865982] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.866247] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.866375] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.866504] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.866668] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.866732] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.866817] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.867197] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.888458] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.888686] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 927.888813] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.888996] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.889336] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-d6a5aa80-0c41-49d7-80b5-5ee098d779ef taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.890248] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-d6a5aa80-0c41-49d7-80b5-5ee098d779ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.890248] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-d6a5aa80-0c41-49d7-80b5-5ee098d779ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.890248] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-d6a5aa80-0c41-49d7-80b5-5ee098d779ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.890248] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6a5aa80-0c41-49d7-80b5-5ee098d779ef',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.301458] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.396022] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.396022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.396022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.396022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.396022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.396022] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port d6a5aa80-0c41-49d7-80b5-5ee098d779ef not found, creating... [ 928.396022] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.396022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.396022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.396022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.396022] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.396713] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.396713] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.396713] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.396713] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.396713] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.397307] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: d6a5aa80-0c41-49d7-80b5-5ee098d779ef is going to be created. [ 928.419024] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.420901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.420901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.420901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.420901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.420901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-d6a5aa80-0c41-49d7-80b5-5ee098d779ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.528995] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 928.529405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.803484] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.803920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.803920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.804018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.804063] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.804142] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be updated. [ 928.834565] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.834769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.834769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.834983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.835145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.849341] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: IN_PROGRESS for 2s [ 929.223980] env[70535]: INFO networking_nsxv3.common.synchronization [req-57e39d67-d7f8-4e95-8afa-fdf5650befc6 req-b0ca1d1a-5992-4f5f-881d-0a87765ff691 service nova] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_rules [ 929.224193] env[70535]: INFO networking_nsxv3.common.synchronization [req-57e39d67-d7f8-4e95-8afa-fdf5650befc6 req-b0ca1d1a-5992-4f5f-881d-0a87765ff691 service nova] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 929.224333] env[70535]: INFO networking_nsxv3.common.synchronization [req-57e39d67-d7f8-4e95-8afa-fdf5650befc6 req-b0ca1d1a-5992-4f5f-881d-0a87765ff691 service nova] Enqueued Resource ID: d6a5aa80-0c41-49d7-80b5-5ee098d779ef with Priority: HIGHEST for action port [ 929.224579] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_rules [ 929.224704] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 929.224796] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6a5aa80-0c41-49d7-80b5-5ee098d779ef with Priority: HIGHEST for action port [ 929.226763] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.226925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.227985] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.227985] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.227985] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.229320] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.229320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.229320] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6a5aa80-0c41-49d7-80b5-5ee098d779ef taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.229320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6a5aa80-0c41-49d7-80b5-5ee098d779ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.229320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6a5aa80-0c41-49d7-80b5-5ee098d779ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.229557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6a5aa80-0c41-49d7-80b5-5ee098d779ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.229557] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6a5aa80-0c41-49d7-80b5-5ee098d779ef',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.583814] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 929.584103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.739210] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6a5aa80-0c41-49d7-80b5-5ee098d779ef with status ACTIVE [ 929.739453] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.739602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.739669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.740133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.741021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.741021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.741021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.741021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.741021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.741021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.741021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.741280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.741280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.741383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.741383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.741460] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6a5aa80-0c41-49d7-80b5-5ee098d779ef is going to be updated. [ 929.742667] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.742756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.765357] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.765534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.765617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.765844] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.765984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.766177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6a5aa80-0c41-49d7-80b5-5ee098d779ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.000763] env[70535]: INFO networking_nsxv3.common.synchronization [req-f448f96f-76ab-4686-bbb2-376a68a80c34 req-d41b4265-2d96-4ec7-8cc8-3fd4e0027c51 tempest-ServerActionsTestJSON-1674828100 tempest-ServerActionsTestJSON-1674828100-project-member] Enqueued Resource ID: 4671052a-29bf-476d-9785-63d1baee1810 with Priority: HIGHEST for action security_group_members [ 930.001529] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4671052a-29bf-476d-9785-63d1baee1810 with Priority: HIGHEST for action security_group_members [ 930.002013] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-4671052a-29bf-476d-9785-63d1baee1810 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.002245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.002392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.002733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.002954] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.003109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.003202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.003416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.003579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.003712] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4671052a-29bf-476d-9785-63d1baee1810',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.511600] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.511735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.511960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.512054] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.512146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.512402] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.512511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.512628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.512781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.514044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.514044] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4671052a-29bf-476d-9785-63d1baee1810 already deleted. [ 930.514044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.634808] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.635206] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.635291] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.635681] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.638299] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.638299] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.638451] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.638740] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.639664] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.639664] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.639664] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.639664] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.639898] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.639972] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.640143] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.640347] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.660739] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.661274] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 930.661274] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.661384] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.661773] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-614a50cd-b226-4f71-91ee-eea67aacec91 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.661773] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-614a50cd-b226-4f71-91ee-eea67aacec91" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.661949] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-614a50cd-b226-4f71-91ee-eea67aacec91" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.662260] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-614a50cd-b226-4f71-91ee-eea67aacec91" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.662406] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('614a50cd-b226-4f71-91ee-eea67aacec91',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.859916] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 930.860213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.860442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.860671] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.860865] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.860983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.861058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.861211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.861293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.861390] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.168333] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.168640] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.168794] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.170373] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.170373] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.170373] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 614a50cd-b226-4f71-91ee-eea67aacec91 not found, creating... [ 931.170373] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.170373] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.170373] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.170373] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.170893] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.170893] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.171031] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.171764] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.172083] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.172236] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.172388] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 614a50cd-b226-4f71-91ee-eea67aacec91 is going to be created. [ 931.194243] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.194465] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.194596] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.194880] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.195146] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.195363] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-614a50cd-b226-4f71-91ee-eea67aacec91" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.364485] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.871513] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.077038] env[70535]: INFO networking_nsxv3.common.synchronization [req-f448f96f-76ab-4686-bbb2-376a68a80c34 req-7acaa500-be9b-4900-80ee-5f582c56bd0a service nova] Enqueued Resource ID: 4671052a-29bf-476d-9785-63d1baee1810 with Priority: HIGHEST for action security_group_rules [ 932.077247] env[70535]: INFO networking_nsxv3.common.synchronization [req-f448f96f-76ab-4686-bbb2-376a68a80c34 req-7acaa500-be9b-4900-80ee-5f582c56bd0a service nova] Enqueued Resource ID: 4671052a-29bf-476d-9785-63d1baee1810 with Priority: HIGHEST for action security_group_members [ 932.077408] env[70535]: INFO networking_nsxv3.common.synchronization [req-f448f96f-76ab-4686-bbb2-376a68a80c34 req-7acaa500-be9b-4900-80ee-5f582c56bd0a service nova] Enqueued Resource ID: 614a50cd-b226-4f71-91ee-eea67aacec91 with Priority: HIGHEST for action port [ 932.077617] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4671052a-29bf-476d-9785-63d1baee1810 with Priority: HIGHEST for action security_group_rules [ 932.077764] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4671052a-29bf-476d-9785-63d1baee1810 with Priority: HIGHEST for action security_group_members [ 932.077877] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614a50cd-b226-4f71-91ee-eea67aacec91 with Priority: HIGHEST for action port [ 932.079735] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4671052a-29bf-476d-9785-63d1baee1810 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.079922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.080028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.080807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.080807] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4671052a-29bf-476d-9785-63d1baee1810',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.081546] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-4671052a-29bf-476d-9785-63d1baee1810 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.081546] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.081669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.081855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.082069] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.082198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.082281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.082448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.082580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.082853] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4671052a-29bf-476d-9785-63d1baee1810',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.083518] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-614a50cd-b226-4f71-91ee-eea67aacec91 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.083705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-614a50cd-b226-4f71-91ee-eea67aacec91" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.083765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-614a50cd-b226-4f71-91ee-eea67aacec91" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.083971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-614a50cd-b226-4f71-91ee-eea67aacec91" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.084112] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('614a50cd-b226-4f71-91ee-eea67aacec91',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.377590] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.377754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.377843] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.378058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.378155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.378262] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be updated. [ 932.426033] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.426033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.426033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.426343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.426493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.436094] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: IN_PROGRESS for 2s [ 932.585916] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-4671052a-29bf-476d-9785-63d1baee1810 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.586087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.586322] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4671052a-29bf-476d-9785-63d1baee1810',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.587567] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 614a50cd-b226-4f71-91ee-eea67aacec91 with status ACTIVE [ 932.587864] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.588152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.588194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.588465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.588612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.588869] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.589091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.589154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.589371] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.589489] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.589723] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.589862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.589951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.590143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.590255] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.590387] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 614a50cd-b226-4f71-91ee-eea67aacec91 is going to be updated. [ 932.612289] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.612472] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.612515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.612798] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.612932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.613107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-614a50cd-b226-4f71-91ee-eea67aacec91" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.092683] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4671052a-29bf-476d-9785-63d1baee1810',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.400996] env[70535]: INFO networking_nsxv3.common.synchronization [req-5d033ae4-a886-4a96-8fd9-06401959a91f req-c155bf89-db89-45c1-8a62-48017d1c7095 tempest-ImagesOneServerNegativeTestJSON-495716502 tempest-ImagesOneServerNegativeTestJSON-495716502-project-member] Enqueued Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 933.401546] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 933.401859] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.401986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.402073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.402287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.402464] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.402544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.402597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.402896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.403051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.403166] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.595254] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.595475] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.595582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.595786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.595878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.595980] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4671052a-29bf-476d-9785-63d1baee1810 is going to be created. [ 933.622897] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.622897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.622897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.622897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.622897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.632176] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4671052a-29bf-476d-9785-63d1baee1810 in Status: UNINITIALIZED for 2s [ 933.861403] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-198 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.861578] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-198" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.861672] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-198" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.862736] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-198" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.862736] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.862736] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.862736] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.863089] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.863089] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.863178] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.863241] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 933.863354] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 933.863461] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 933.863598] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.863722] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 933.863854] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 933.885136] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 933.885307] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 933.885448] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 933.886024] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-198" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.886024] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-cd771461-a802-4548-b786-925a2be9c0f0 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.886288] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-cd771461-a802-4548-b786-925a2be9c0f0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.886338] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-cd771461-a802-4548-b786-925a2be9c0f0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.886949] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-cd771461-a802-4548-b786-925a2be9c0f0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.886949] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd771461-a802-4548-b786-925a2be9c0f0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.906143] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.906303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.906532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.906789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.906899] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.907139] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.907247] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.907308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.907460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.907539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.907626] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50631980-025e-4f7c-a21a-486351e09d1f is going to be deleted. [ 933.933839] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.933987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.934076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.934291] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.934383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.934486] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.389494] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.389863] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.389903] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.390201] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.390352] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.390512] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port cd771461-a802-4548-b786-925a2be9c0f0 not found, creating... [ 934.390775] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.390935] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.391067] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.391294] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.391437] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.391728] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.391888] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.392018] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.392230] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.392367] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.392507] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: cd771461-a802-4548-b786-925a2be9c0f0 is going to be created. [ 934.414100] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.414368] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.414551] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.414917] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.415248] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.415581] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-cd771461-a802-4548-b786-925a2be9c0f0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.445962] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 934.446278] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.446524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.446852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.447103] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.447260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.447555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.447555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.447660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.447787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.447904] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.950942] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.951158] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.951223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.951453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.952037] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.952037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.952037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.952037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.952037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.952301] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.952301] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.952385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.952446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.952597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.952736] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.952825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.952884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.953042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.953121] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.953201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.953308] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.204258] env[70535]: INFO networking_nsxv3.common.synchronization [req-5d033ae4-a886-4a96-8fd9-06401959a91f req-3d5af117-3cb2-4767-97a2-b64dc7d5ee34 service nova] Enqueued Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_rules [ 935.204258] env[70535]: INFO networking_nsxv3.common.synchronization [req-5d033ae4-a886-4a96-8fd9-06401959a91f req-3d5af117-3cb2-4767-97a2-b64dc7d5ee34 service nova] Enqueued Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 935.204258] env[70535]: INFO networking_nsxv3.common.synchronization [req-5d033ae4-a886-4a96-8fd9-06401959a91f req-3d5af117-3cb2-4767-97a2-b64dc7d5ee34 service nova] Enqueued Resource ID: cd771461-a802-4548-b786-925a2be9c0f0 with Priority: HIGHEST for action port [ 935.204258] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_rules [ 935.204680] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 935.204680] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd771461-a802-4548-b786-925a2be9c0f0 with Priority: HIGHEST for action port [ 935.204828] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.204951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.205685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.206017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.206017] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.207364] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.207551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.207551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.208023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.208122] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.208227] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.208288] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.208441] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.208523] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.208613] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.209434] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd771461-a802-4548-b786-925a2be9c0f0 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.209545] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd771461-a802-4548-b786-925a2be9c0f0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.209607] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd771461-a802-4548-b786-925a2be9c0f0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.210375] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd771461-a802-4548-b786-925a2be9c0f0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.210375] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd771461-a802-4548-b786-925a2be9c0f0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.457296] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec7c706b-a1b7-4402-b5c2-6e8302636c80: rpc.has_security_group_logging(os_id): False [ 935.475189] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.475454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.475454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.475749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.475847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.476165] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.476298] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.476367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.476551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.476660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.476898] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.477144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.477144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.477240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.477296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.477516] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.477604] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.477685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.477825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.477906] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.478022] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be updated. [ 935.541136] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.541415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.541415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.541675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.541825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.555340] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: IN_PROGRESS for 2s [ 935.647387] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4671052a-29bf-476d-9785-63d1baee1810 in Status: SUCCESS [ 935.647630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.647834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.648729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.648729] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.648729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.648729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.648963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.648963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.648963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.649056] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4671052a-29bf-476d-9785-63d1baee1810',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.711574] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.711765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.711956] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.713792] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd771461-a802-4548-b786-925a2be9c0f0 with status ACTIVE [ 935.713792] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.713792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.713792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.713792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.713792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.714270] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.714559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.714559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.714664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.715961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.715961] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.715961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.715961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.715961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.715961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.715961] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd771461-a802-4548-b786-925a2be9c0f0 is going to be updated. [ 935.750539] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.750539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.750539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.750539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.750539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.750539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd771461-a802-4548-b786-925a2be9c0f0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.991656] env[70535]: INFO networking_nsxv3.common.synchronization [req-49685f56-b2c5-4f1b-ad50-5ed40bfe7067 req-79d4f6a2-5882-4551-b9a8-8d1a2991c4a2 tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 with Priority: HIGHEST for action security_group_members [ 935.992273] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 with Priority: HIGHEST for action security_group_members [ 935.992593] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc5fb1bb-573b-4a41-9b95-86e55eedb265 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.992726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.992794] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.993318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.993444] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.993593] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.993644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.993824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.993911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.994063] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc5fb1bb-573b-4a41-9b95-86e55eedb265',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.151802] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4671052a-29bf-476d-9785-63d1baee1810',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.217417] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.497664] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.497989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.497989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.498206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.498308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.498532] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.498630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.498701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.498875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.498957] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.499057] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 already deleted. [ 936.499141] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.575857] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.575857] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.575857] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.575857] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.576159] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.576159] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.576238] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.576550] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.576653] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.576835] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.576951] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 936.580600] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 936.580600] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 936.580600] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.580600] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 936.580828] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 936.603920] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 936.604118] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 936.604263] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 936.604445] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.604888] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-d3118dbd-b913-4a00-9018-8a78adb27b06 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.605100] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-d3118dbd-b913-4a00-9018-8a78adb27b06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.605233] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-d3118dbd-b913-4a00-9018-8a78adb27b06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.605543] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-d3118dbd-b913-4a00-9018-8a78adb27b06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.605725] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3118dbd-b913-4a00-9018-8a78adb27b06',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.653859] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4671052a-29bf-476d-9785-63d1baee1810: rpc.has_security_group_logging(os_id): False [ 936.677484] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.677639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.677697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.677922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.678019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.678263] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.678365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.678441] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.678599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.678672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.678792] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4671052a-29bf-476d-9785-63d1baee1810 is going to be created. [ 936.719924] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.720111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.720182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.720397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.720491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.720662] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50631980-025e-4f7c-a21a-486351e09d1f is going to be created. [ 936.748263] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.749295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.749295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.749567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.749673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.769472] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.769935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.770177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.770503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.770778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.772617] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4671052a-29bf-476d-9785-63d1baee1810 in Status: IN_PROGRESS for 2s [ 936.784091] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: UNINITIALIZED for 2s [ 937.109120] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.109423] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.109597] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.109907] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.110114] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.110293] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port d3118dbd-b913-4a00-9018-8a78adb27b06 not found, creating... [ 937.110581] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.110774] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.110895] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.111174] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.111347] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.111669] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.111990] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.112278] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.112467] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.112813] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.113851] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: d3118dbd-b913-4a00-9018-8a78adb27b06 is going to be created. [ 937.134057] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.134307] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.134437] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.134719] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.134957] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.135206] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-d3118dbd-b913-4a00-9018-8a78adb27b06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.570780] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 937.571170] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.229972] env[70535]: INFO networking_nsxv3.common.synchronization [req-49685f56-b2c5-4f1b-ad50-5ed40bfe7067 req-342d826a-268e-477e-89df-8d0fd8a2bac0 service nova] Enqueued Resource ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 with Priority: HIGHEST for action security_group_rules [ 938.230190] env[70535]: INFO networking_nsxv3.common.synchronization [req-49685f56-b2c5-4f1b-ad50-5ed40bfe7067 req-342d826a-268e-477e-89df-8d0fd8a2bac0 service nova] Enqueued Resource ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 with Priority: HIGHEST for action security_group_members [ 938.230337] env[70535]: INFO networking_nsxv3.common.synchronization [req-49685f56-b2c5-4f1b-ad50-5ed40bfe7067 req-342d826a-268e-477e-89df-8d0fd8a2bac0 service nova] Enqueued Resource ID: d3118dbd-b913-4a00-9018-8a78adb27b06 with Priority: HIGHEST for action port [ 938.230570] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 with Priority: HIGHEST for action security_group_rules [ 938.230690] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 with Priority: HIGHEST for action security_group_members [ 938.230784] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3118dbd-b913-4a00-9018-8a78adb27b06 with Priority: HIGHEST for action port [ 938.231366] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.231492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.231559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.231766] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.231937] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc5fb1bb-573b-4a41-9b95-86e55eedb265',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.232693] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc5fb1bb-573b-4a41-9b95-86e55eedb265 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.232805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.232873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.233065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.233211] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.233302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.233363] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.233513] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.234501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.234501] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc5fb1bb-573b-4a41-9b95-86e55eedb265',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.234501] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3118dbd-b913-4a00-9018-8a78adb27b06 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.234675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3118dbd-b913-4a00-9018-8a78adb27b06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.234675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3118dbd-b913-4a00-9018-8a78adb27b06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.234789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3118dbd-b913-4a00-9018-8a78adb27b06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.234819] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3118dbd-b913-4a00-9018-8a78adb27b06',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.736624] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc5fb1bb-573b-4a41-9b95-86e55eedb265 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.736936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.737015] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc5fb1bb-573b-4a41-9b95-86e55eedb265',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.737910] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3118dbd-b913-4a00-9018-8a78adb27b06 with status ACTIVE [ 938.738103] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.738229] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.738309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.738544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.738659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.738908] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.738994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.739054] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.739249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.739340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.739526] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.739640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.739707] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.739852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.739929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.740042] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3118dbd-b913-4a00-9018-8a78adb27b06 is going to be updated. [ 938.760956] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.761134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.761206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.761419] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.761561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.761721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3118dbd-b913-4a00-9018-8a78adb27b06" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.783976] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4671052a-29bf-476d-9785-63d1baee1810 in Status: SUCCESS [ 938.784242] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.792720] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: SUCCESS [ 938.792943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.793112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.794096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.794096] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.794096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.794096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.794096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.794096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.794096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.794096] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.241769] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc5fb1bb-573b-4a41-9b95-86e55eedb265',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.296149] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.296345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.297405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.297405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.297405] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.297405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.297405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.297405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.297405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.297405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.297811] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.297811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.297811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.297811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.297921] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.297971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.298568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.298568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.298568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.298568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.298568] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.744737] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.744737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.744737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.744737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.744737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.744737] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 is going to be created. [ 939.774422] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.774662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.774775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.775116] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.775357] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.786891] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 in Status: UNINITIALIZED for 2s [ 939.800535] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50631980-025e-4f7c-a21a-486351e09d1f: rpc.has_security_group_logging(os_id): False [ 939.825079] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.825316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.825316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.825519] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.825664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.825947] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.826082] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.826137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.826358] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.826448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.826748] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.826884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.826975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.827119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.827200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.827398] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.827498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.827552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.827704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.827805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.827897] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50631980-025e-4f7c-a21a-486351e09d1f is going to be created. [ 939.924953] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.925156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.925200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.925407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.925588] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.940452] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: IN_PROGRESS for 2s [ 941.174879] env[70535]: INFO networking_nsxv3.common.synchronization [req-b7285161-39d4-4db2-b6e0-117bf81c8fd6 req-db8ae848-bcd7-4f7d-b2a5-c13f5769b263 tempest-MultipleCreateTestJSON-1547146489 tempest-MultipleCreateTestJSON-1547146489-project-member] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 941.175302] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 941.175504] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.175729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.175729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.175939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.176094] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.176200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.176261] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.176498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.176498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.176586] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.614322] env[70535]: INFO networking_nsxv3.common.synchronization [req-d286c133-8b70-4532-817e-ae1729ae697a req-3a56cf24-8d55-4f81-b27e-ca6f399acfb5 tempest-MultipleCreateTestJSON-1547146489 tempest-MultipleCreateTestJSON-1547146489-project-member] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 941.614889] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 941.615213] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.615318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.679991] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.800173] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 in Status: SUCCESS [ 941.800173] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.800385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.800472] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.800681] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.800797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.800858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.801027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.801104] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.801195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.801288] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc5fb1bb-573b-4a41-9b95-86e55eedb265',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.966971] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: SUCCESS [ 941.966971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.182597] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.308347] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc5fb1bb-573b-4a41-9b95-86e55eedb265',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.684632] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.684632] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.684821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.684919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.685018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.685123] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be updated. [ 942.725572] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.727374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.727374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.727374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.727374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.737055] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: IN_PROGRESS for 2s [ 942.809988] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc5fb1bb-573b-4a41-9b95-86e55eedb265: rpc.has_security_group_logging(os_id): False [ 942.828592] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.830846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.831658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.831658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.831658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.831658] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.831658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.831858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.831858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.831946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.832042] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 is going to be created. [ 942.900654] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.900830] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.901017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.901114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.901297] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.913296] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 in Status: IN_PROGRESS for 2s [ 944.748024] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 944.748024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.748024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.748024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.748413] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.748413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.748413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.748544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.749077] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.749077] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.932205] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 in Status: SUCCESS [ 944.932515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.252152] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.252332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.252422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.252590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.252680] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.252874] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.252987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.253090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.253189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.253266] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.253354] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be updated. [ 945.281156] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.281455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.281549] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.281750] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.282036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.294151] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: IN_PROGRESS for 2s [ 945.383326] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.383554] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.383788] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.384679] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.384679] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.384679] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.384965] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.384995] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.387438] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.387438] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.387438] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.387438] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.387438] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.387438] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.387438] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.387438] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.410228] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.410432] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 945.410576] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.410759] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.411109] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.411284] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.411402] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.411699] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.411891] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cebb52c4-6dd6-4c4f-b646-3ba641fc4e66',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.918031] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.918031] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.918031] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.918031] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.918031] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.918031] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.918031] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.918031] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.918031] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.918031] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.919146] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.919534] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.919982] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.920376] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.920655] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.921085] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 is going to be updated. [ 945.946778] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.946778] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.946778] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.947409] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.952091] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.952091] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.552277] env[70535]: INFO networking_nsxv3.common.synchronization [None req-0a61af91-11fc-4c10-a01b-0fdff17c7ac3 None None] Enqueued Resource ID: 75639b6d-0811-4cd6-9dde-a9d50e854ec2 with Priority: HIGHEST for action port [ 946.552277] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75639b6d-0811-4cd6-9dde-a9d50e854ec2 with Priority: HIGHEST for action port [ 946.552277] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-75639b6d-0811-4cd6-9dde-a9d50e854ec2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.552663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75639b6d-0811-4cd6-9dde-a9d50e854ec2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.552663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75639b6d-0811-4cd6-9dde-a9d50e854ec2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.552911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75639b6d-0811-4cd6-9dde-a9d50e854ec2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.552911] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75639b6d-0811-4cd6-9dde-a9d50e854ec2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.009011] env[70535]: INFO networking_nsxv3.common.synchronization [req-ee67cae8-8d9f-436f-9406-c08057ca5e3b req-632b68f4-882e-4eeb-96f3-f6d5775505c7 service nova] Enqueued Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_rules [ 947.009310] env[70535]: INFO networking_nsxv3.common.synchronization [req-ee67cae8-8d9f-436f-9406-c08057ca5e3b req-632b68f4-882e-4eeb-96f3-f6d5775505c7 service nova] Enqueued Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_members [ 947.009373] env[70535]: INFO networking_nsxv3.common.synchronization [req-ee67cae8-8d9f-436f-9406-c08057ca5e3b req-632b68f4-882e-4eeb-96f3-f6d5775505c7 service nova] Enqueued Resource ID: cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 with Priority: HIGHEST for action port [ 947.009594] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_rules [ 947.009681] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_members [ 947.009774] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 with Priority: HIGHEST for action port [ 947.010796] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c30db4ac-0243-4260-914e-2e6a0283c93a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.010893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.010939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.011156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.011565] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.012154] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c30db4ac-0243-4260-914e-2e6a0283c93a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.012273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.012395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.012551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.012746] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.012882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.012932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.013317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.013317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.013317] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.015447] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.015447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.015447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.015447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.015447] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cebb52c4-6dd6-4c4f-b646-3ba641fc4e66',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.058233] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75639b6d-0811-4cd6-9dde-a9d50e854ec2 [ 947.058233] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.058233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.058233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.058759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.058926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.059079] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75639b6d-0811-4cd6-9dde-a9d50e854ec2 already deleted. [ 947.059211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75639b6d-0811-4cd6-9dde-a9d50e854ec2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.304300] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 947.304446] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 deletion is rescheduled due to dependency. [ 947.304527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.517673] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c30db4ac-0243-4260-914e-2e6a0283c93a taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.518058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.520338] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 with status ACTIVE [ 947.520338] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.520338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.520338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.520338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.520338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.520338] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.523528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.523528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.523528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.523528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.523528] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.523528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.523528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.523528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.523528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.523528] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cebb52c4-6dd6-4c4f-b646-3ba641fc4e66 is going to be updated. [ 947.523528] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.562037] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.562037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.562037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.562037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.562037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.562037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cebb52c4-6dd6-4c4f-b646-3ba641fc4e66" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.024935] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.531459] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.531459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.531459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.531459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.531459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.531459] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c30db4ac-0243-4260-914e-2e6a0283c93a is going to be updated. [ 948.568114] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.568114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.568328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.568903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.568903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.580087] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c30db4ac-0243-4260-914e-2e6a0283c93a in Status: IN_PROGRESS for 2s [ 948.598584] env[70535]: INFO networking_nsxv3.common.synchronization [req-e9dd71d9-76e6-4021-be1d-289cb8e73b8a req-b1bcd59a-880e-47ad-91b5-720fe51f2be9 tempest-ServersNegativeTestJSON-1344173276 tempest-ServersNegativeTestJSON-1344173276-project-member] Enqueued Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_members [ 948.599204] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_members [ 948.599562] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.599718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.599811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.600155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.600353] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.600469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.600534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.600713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.600819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.600958] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.106214] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.106515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.106515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.106736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.106821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.107010] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.107132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.107221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.107493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.107644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.107762] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 already deleted. [ 949.107901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.163370] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-421 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.163619] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-421" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.163745] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-421" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.164121] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-421" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.164385] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.164548] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.164666] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.164888] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.165060] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.165393] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 949.165537] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 949.165685] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 949.165930] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 949.165998] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 949.166135] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 949.166323] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 949.203169] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 949.203345] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 949.203474] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 949.203775] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-421" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.204222] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-e8502457-3e1c-459a-9499-fa08683817a8 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.204431] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.204564] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.204893] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.205058] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8502457-3e1c-459a-9499-fa08683817a8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.256183] env[70535]: INFO networking_nsxv3.common.synchronization [None req-4f239ecc-6bcd-4b43-9d4e-159ffad73840 None None] Enqueued Resource ID: fdaa64d4-c9fe-498a-89d5-cf38ef48c86e with Priority: HIGHEST for action port [ 949.256183] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdaa64d4-c9fe-498a-89d5-cf38ef48c86e with Priority: HIGHEST for action port [ 949.256183] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdaa64d4-c9fe-498a-89d5-cf38ef48c86e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.256183] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdaa64d4-c9fe-498a-89d5-cf38ef48c86e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.256453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdaa64d4-c9fe-498a-89d5-cf38ef48c86e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.256861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdaa64d4-c9fe-498a-89d5-cf38ef48c86e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.257082] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdaa64d4-c9fe-498a-89d5-cf38ef48c86e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.708407] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.708878] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.709142] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.709660] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.709822] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.710206] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port e8502457-3e1c-459a-9499-fa08683817a8 not found, creating... [ 949.710739] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.710884] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.711542] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.712307] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.712559] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.713013] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.713275] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.713452] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.713766] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.713984] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.714250] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: e8502457-3e1c-459a-9499-fa08683817a8 is going to be created. [ 949.744320] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.745245] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.745245] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.745245] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.745614] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.746726] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.760139] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fdaa64d4-c9fe-498a-89d5-cf38ef48c86e [ 949.760473] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.760601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.760671] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.760888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.760976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.761094] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fdaa64d4-c9fe-498a-89d5-cf38ef48c86e already deleted. [ 949.761203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdaa64d4-c9fe-498a-89d5-cf38ef48c86e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.462721] env[70535]: INFO networking_nsxv3.common.synchronization [req-e9dd71d9-76e6-4021-be1d-289cb8e73b8a req-4da52c41-1952-4491-8c32-925531611837 service nova] Enqueued Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_rules [ 950.462987] env[70535]: INFO networking_nsxv3.common.synchronization [req-e9dd71d9-76e6-4021-be1d-289cb8e73b8a req-4da52c41-1952-4491-8c32-925531611837 service nova] Enqueued Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_members [ 950.463061] env[70535]: INFO networking_nsxv3.common.synchronization [req-e9dd71d9-76e6-4021-be1d-289cb8e73b8a req-4da52c41-1952-4491-8c32-925531611837 service nova] Enqueued Resource ID: e8502457-3e1c-459a-9499-fa08683817a8 with Priority: HIGHEST for action port [ 950.463560] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_rules [ 950.465238] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_members [ 950.465238] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8502457-3e1c-459a-9499-fa08683817a8 with Priority: HIGHEST for action port [ 950.465238] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.465238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.465238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.465238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.465238] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.465652] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.465652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.465726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.465975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.466460] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.470042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.470042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.470042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.470042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.470042] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.470042] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8502457-3e1c-459a-9499-fa08683817a8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.470042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.470042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.470042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.470042] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8502457-3e1c-459a-9499-fa08683817a8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.592020] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c30db4ac-0243-4260-914e-2e6a0283c93a in Status: SUCCESS [ 950.592020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.592020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.592386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.592386] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.592505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.592505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.592670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.592745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.593109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.593254] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.969873] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.971322] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.971492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.971722] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8502457-3e1c-459a-9499-fa08683817a8 with status ACTIVE [ 950.971850] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.971935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.971990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.972240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.972365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.972597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.972658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.972702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.972853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.972950] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.973208] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.973303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.973363] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.973504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.973573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.973662] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8502457-3e1c-459a-9499-fa08683817a8 is going to be updated. [ 950.998920] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.998920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.998920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.998920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.998920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.998920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.095987] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.475678] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.598308] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c30db4ac-0243-4260-914e-2e6a0283c93a: rpc.has_security_group_logging(os_id): False [ 951.619409] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.619409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.619409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.619747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.619946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.620862] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.620862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.620862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.620862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.620862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.621113] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c30db4ac-0243-4260-914e-2e6a0283c93a is going to be created. [ 951.687335] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.687565] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.687690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.687999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.688482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.706241] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c30db4ac-0243-4260-914e-2e6a0283c93a in Status: IN_PROGRESS for 2s [ 951.977995] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.978208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.978284] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.978508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.978599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.978699] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 is going to be created. [ 952.008485] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.008485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.008485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.008485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.008485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.025984] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: UNINITIALIZED for 2s [ 953.723230] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c30db4ac-0243-4260-914e-2e6a0283c93a in Status: SUCCESS [ 953.723485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.041525] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: SUCCESS [ 954.043509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.043509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.043509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.043509] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.043509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.043509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.043509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.043509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.043509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.043509] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.288892] env[70535]: INFO networking_nsxv3.common.synchronization [req-481baecd-3de9-4727-8f42-6b3b0d1bd6e5 req-2397cd88-6f37-47e3-9575-6dc419b8177d tempest-ImagesTestJSON-1564979202 tempest-ImagesTestJSON-1564979202-project-member] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 954.289503] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 954.291138] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.291302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.291363] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.291692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.291858] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.292032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.292087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.292268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.292359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.292479] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.549416] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.549416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.549416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.549416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.549416] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.549416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.549416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.549416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.549416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.549416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.549416] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.549416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.549416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.549416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.549416] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.549416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.550000] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.550000] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.550000] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.550000] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.550000] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.752993] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.752993] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.753382] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.753468] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.754157] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.754380] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.754511] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.754752] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.754904] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.755141] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.755251] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.755362] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.755477] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.755591] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.755703] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.755913] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.780644] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.780644] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 954.780644] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.780644] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.781912] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-82a67b43-268c-4e99-97d6-2a15ff79a028 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.781912] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-82a67b43-268c-4e99-97d6-2a15ff79a028" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.781912] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-82a67b43-268c-4e99-97d6-2a15ff79a028" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.781912] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-82a67b43-268c-4e99-97d6-2a15ff79a028" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.781912] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82a67b43-268c-4e99-97d6-2a15ff79a028',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.794203] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.052462] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878: rpc.has_security_group_logging(os_id): False [ 955.077698] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.077868] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.077941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.078494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.078494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.078576] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.078652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.078652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.078845] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.078895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.079114] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.079396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.079396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.079563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.079563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.079712] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.079940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.079940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.080044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.080084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.080197] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 is going to be created. [ 955.174034] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.174034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.174034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.174034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.174034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.187762] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: IN_PROGRESS for 2s [ 955.283613] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.283982] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.284140] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.284417] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.284568] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.284731] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 82a67b43-268c-4e99-97d6-2a15ff79a028 not found, creating... [ 955.285150] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.286032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.286032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.286032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.286032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.286990] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.287197] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.287321] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.287559] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.287698] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.287871] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 82a67b43-268c-4e99-97d6-2a15ff79a028 is going to be created. [ 955.297132] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.319675] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.319901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.320049] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.320356] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.320593] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.321341] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-82a67b43-268c-4e99-97d6-2a15ff79a028" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.801344] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.801608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.801608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.801693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.801787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.801884] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 955.838249] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.838332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.838384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.838604] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.838766] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.851196] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 956.108688] env[70535]: INFO networking_nsxv3.common.synchronization [req-481baecd-3de9-4727-8f42-6b3b0d1bd6e5 req-8ac8ac97-ae03-4d0f-9438-8806b1c45cc7 service nova] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_rules [ 956.108878] env[70535]: INFO networking_nsxv3.common.synchronization [req-481baecd-3de9-4727-8f42-6b3b0d1bd6e5 req-8ac8ac97-ae03-4d0f-9438-8806b1c45cc7 service nova] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 956.109084] env[70535]: INFO networking_nsxv3.common.synchronization [req-481baecd-3de9-4727-8f42-6b3b0d1bd6e5 req-8ac8ac97-ae03-4d0f-9438-8806b1c45cc7 service nova] Enqueued Resource ID: 82a67b43-268c-4e99-97d6-2a15ff79a028 with Priority: HIGHEST for action port [ 956.115248] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_rules [ 956.115489] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 956.115605] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82a67b43-268c-4e99-97d6-2a15ff79a028 with Priority: HIGHEST for action port [ 956.116481] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.116674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.116714] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.116930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.117060] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.121323] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.121505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.122208] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-82a67b43-268c-4e99-97d6-2a15ff79a028 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.122208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82a67b43-268c-4e99-97d6-2a15ff79a028" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.122208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82a67b43-268c-4e99-97d6-2a15ff79a028" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.122457] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82a67b43-268c-4e99-97d6-2a15ff79a028" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.122457] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82a67b43-268c-4e99-97d6-2a15ff79a028',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.571425] env[70535]: INFO networking_nsxv3.common.synchronization [None req-7ce30986-a55e-47d7-b55f-e8b3959ec77a None None] Enqueued Resource ID: 66a8dd66-6f90-4cff-976e-f0b2600c14a2 with Priority: HIGHEST for action port [ 956.571949] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66a8dd66-6f90-4cff-976e-f0b2600c14a2 with Priority: HIGHEST for action port [ 956.572335] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-66a8dd66-6f90-4cff-976e-f0b2600c14a2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.572464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66a8dd66-6f90-4cff-976e-f0b2600c14a2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.575733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66a8dd66-6f90-4cff-976e-f0b2600c14a2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.577751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66a8dd66-6f90-4cff-976e-f0b2600c14a2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.577869] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66a8dd66-6f90-4cff-976e-f0b2600c14a2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.624814] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.624944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.625142] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82a67b43-268c-4e99-97d6-2a15ff79a028 with status ACTIVE [ 956.625300] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.625402] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.625462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.625679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.625803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.626060] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.626196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.626286] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.626507] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.626620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.626904] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.627076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.627355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.627407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.627590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.627662] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82a67b43-268c-4e99-97d6-2a15ff79a028 is going to be updated. [ 956.651939] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.651939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.651939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.651939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.651939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.651939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82a67b43-268c-4e99-97d6-2a15ff79a028" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.081024] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66a8dd66-6f90-4cff-976e-f0b2600c14a2 [ 957.081024] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.081365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.081365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.081426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.081512] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.081624] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66a8dd66-6f90-4cff-976e-f0b2600c14a2 already deleted. [ 957.081710] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66a8dd66-6f90-4cff-976e-f0b2600c14a2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.210164] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: SUCCESS [ 957.210164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.521663] env[70535]: INFO networking_nsxv3.common.synchronization [req-0f683d4f-0f49-4df2-a920-c9afe27cde02 req-deaae6fd-d328-4f62-95e3-5540e4352ceb tempest-SecurityGroupRulesTestJSON-869214654 tempest-SecurityGroupRulesTestJSON-869214654-project-member] Enqueued Resource ID: 536b504f-b932-41b4-aeb6-fcea1637877a with Priority: HIGHEST for action security_group_rules [ 957.521663] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 536b504f-b932-41b4-aeb6-fcea1637877a with Priority: HIGHEST for action security_group_rules [ 957.521663] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-536b504f-b932-41b4-aeb6-fcea1637877a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.521663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-536b504f-b932-41b4-aeb6-fcea1637877a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.522291] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-536b504f-b932-41b4-aeb6-fcea1637877a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.522291] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-536b504f-b932-41b4-aeb6-fcea1637877a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.523309] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('536b504f-b932-41b4-aeb6-fcea1637877a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.827238] env[70535]: INFO networking_nsxv3.common.synchronization [req-d7f9cfb1-eea8-4e1f-a359-bff62c7c8357 req-07787f54-8185-4ad2-9869-e42498edf91c tempest-ImagesOneServerNegativeTestJSON-495716502 tempest-ImagesOneServerNegativeTestJSON-495716502-project-member] Enqueued Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 957.827238] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 957.827238] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.827238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.827238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.828265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.831762] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.831762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.831762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.831762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.831762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.831762] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.865215] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 957.865215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.865215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.865215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.865215] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.865215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.865215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.865215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.865215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.865215] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.955051] env[70535]: INFO networking_nsxv3.common.synchronization [req-c9b79aa2-b0e8-439e-96a4-d87d29ad2dfa req-ba99a07b-1d45-41f1-a2ed-35a3589b00a4 tempest-DeleteServersTestJSON-660883378 tempest-DeleteServersTestJSON-660883378-project-member] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 957.955051] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 957.955051] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.955467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.955467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.955674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.956414] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.956414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.956414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.956414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.956414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.956679] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.039758] env[70535]: INFO networking_nsxv3.common.synchronization [req-79499497-cbac-4842-b0b6-c790d5cd85c4 req-642e5712-6737-4a16-9cbe-ab92e7713921 tempest-SecurityGroupRulesTestJSON-869214654 tempest-SecurityGroupRulesTestJSON-869214654-project-member] Enqueued Resource ID: 0113c841-bbb8-40b9-ba66-c029e9c19862 with Priority: HIGHEST for action security_group_rules [ 958.040441] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0113c841-bbb8-40b9-ba66-c029e9c19862 with Priority: HIGHEST for action security_group_rules [ 958.040937] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0113c841-bbb8-40b9-ba66-c029e9c19862 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.045202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0113c841-bbb8-40b9-ba66-c029e9c19862" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.045202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0113c841-bbb8-40b9-ba66-c029e9c19862" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.046454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0113c841-bbb8-40b9-ba66-c029e9c19862" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.046454] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0113c841-bbb8-40b9-ba66-c029e9c19862',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.047439] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.047560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.047684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.047805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.047894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.048018] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 536b504f-b932-41b4-aeb6-fcea1637877a already deleted. [ 958.048191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-536b504f-b932-41b4-aeb6-fcea1637877a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.332766] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.333060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.333060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.333155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.333252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.333457] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.333559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.333621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.333780] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.333857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.333944] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50631980-025e-4f7c-a21a-486351e09d1f is going to be updated. [ 958.370695] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.370695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.370695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.370964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.371067] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.373148] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.387486] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: IN_PROGRESS for 2s [ 958.458505] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.458755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.458872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.459258] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.459427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.459748] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.459922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.460092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.462290] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.462290] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.462290] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f already deleted. [ 958.462290] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.571648] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.572810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.572810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.572810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.572810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.572810] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0113c841-bbb8-40b9-ba66-c029e9c19862 already deleted. [ 958.572810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0113c841-bbb8-40b9-ba66-c029e9c19862" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.881466] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.931515] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.931949] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.932259] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.933577] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.934278] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.934727] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.934980] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.935527] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.935695] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.935989] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.936154] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.936494] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.936678] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.936814] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.936988] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.937117] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.961161] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.961161] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 958.961161] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.961161] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.961161] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-75a2bad8-adcd-4f47-8cfa-56281a1deddd taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.961161] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-75a2bad8-adcd-4f47-8cfa-56281a1deddd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.961161] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-75a2bad8-adcd-4f47-8cfa-56281a1deddd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.961161] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-75a2bad8-adcd-4f47-8cfa-56281a1deddd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.961161] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75a2bad8-adcd-4f47-8cfa-56281a1deddd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.387414] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.387928] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.387928] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.387928] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.388093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.388093] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 959.431405] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.431584] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.431650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.431915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.432079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.456812] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 959.463916] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.464219] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.464299] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.464595] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.464748] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.464923] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 75a2bad8-adcd-4f47-8cfa-56281a1deddd not found, creating... [ 959.465246] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.465414] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.465508] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.465738] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.465929] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.466207] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.466373] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.466491] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.467054] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.467054] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.467054] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 75a2bad8-adcd-4f47-8cfa-56281a1deddd is going to be created. [ 959.490622] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.490622] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.490622] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.490622] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.490622] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.490622] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-75a2bad8-adcd-4f47-8cfa-56281a1deddd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.579124] env[70535]: INFO networking_nsxv3.common.synchronization [req-9cb3324a-b343-437d-96c5-77c4958b8542 req-fe561c3d-298f-4215-91d2-f0fd2cbf6026 tempest-SecurityGroupRulesTestJSON-869214654 tempest-SecurityGroupRulesTestJSON-869214654-project-member] Enqueued Resource ID: 7b261301-0b54-433e-bcd0-ff3ba0b0e40b with Priority: HIGHEST for action security_group_rules [ 959.579701] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b261301-0b54-433e-bcd0-ff3ba0b0e40b with Priority: HIGHEST for action security_group_rules [ 959.580027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b261301-0b54-433e-bcd0-ff3ba0b0e40b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.580209] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b261301-0b54-433e-bcd0-ff3ba0b0e40b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.580399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b261301-0b54-433e-bcd0-ff3ba0b0e40b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.580663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b261301-0b54-433e-bcd0-ff3ba0b0e40b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.580663] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b261301-0b54-433e-bcd0-ff3ba0b0e40b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.596757] env[70535]: INFO networking_nsxv3.common.synchronization [None req-68cb23f5-0481-4662-a78e-e85d38446e9b None None] Enqueued Resource ID: 3960c73e-3c59-44e7-88b6-9455be09244f with Priority: HIGHEST for action port [ 959.597018] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3960c73e-3c59-44e7-88b6-9455be09244f with Priority: HIGHEST for action port [ 959.597959] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-3960c73e-3c59-44e7-88b6-9455be09244f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.602415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3960c73e-3c59-44e7-88b6-9455be09244f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.602492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3960c73e-3c59-44e7-88b6-9455be09244f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.602795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3960c73e-3c59-44e7-88b6-9455be09244f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.602888] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3960c73e-3c59-44e7-88b6-9455be09244f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.107102] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.108144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.108144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.108416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.111072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.111072] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b261301-0b54-433e-bcd0-ff3ba0b0e40b already deleted. [ 960.111072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b261301-0b54-433e-bcd0-ff3ba0b0e40b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.111072] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3960c73e-3c59-44e7-88b6-9455be09244f [ 960.111072] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.111072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.111072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.111072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.111072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.111072] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3960c73e-3c59-44e7-88b6-9455be09244f already deleted. [ 960.111072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3960c73e-3c59-44e7-88b6-9455be09244f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.403337] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: SUCCESS [ 960.403337] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50631980-025e-4f7c-a21a-486351e09d1f deletion is rescheduled due to dependency. [ 960.403721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.704672] env[70535]: INFO networking_nsxv3.common.synchronization [req-c9b79aa2-b0e8-439e-96a4-d87d29ad2dfa req-32348e33-7fa3-4e95-ba4a-1301090b10bd service nova] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_rules [ 960.704864] env[70535]: INFO networking_nsxv3.common.synchronization [req-c9b79aa2-b0e8-439e-96a4-d87d29ad2dfa req-32348e33-7fa3-4e95-ba4a-1301090b10bd service nova] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 960.705107] env[70535]: INFO networking_nsxv3.common.synchronization [req-c9b79aa2-b0e8-439e-96a4-d87d29ad2dfa req-32348e33-7fa3-4e95-ba4a-1301090b10bd service nova] Enqueued Resource ID: 75a2bad8-adcd-4f47-8cfa-56281a1deddd with Priority: HIGHEST for action port [ 960.705382] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_rules [ 960.705513] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 960.705610] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75a2bad8-adcd-4f47-8cfa-56281a1deddd with Priority: HIGHEST for action port [ 960.706720] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.706931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.707049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.707373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.707492] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.708420] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.708756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.708874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.709174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.709370] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.709504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.709591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.709852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.709994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.710129] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.711095] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-75a2bad8-adcd-4f47-8cfa-56281a1deddd taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.712590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75a2bad8-adcd-4f47-8cfa-56281a1deddd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.712590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75a2bad8-adcd-4f47-8cfa-56281a1deddd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.712590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75a2bad8-adcd-4f47-8cfa-56281a1deddd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.712590] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75a2bad8-adcd-4f47-8cfa-56281a1deddd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.865201] env[70535]: INFO networking_nsxv3.common.synchronization [req-62279bf1-6ccc-4da4-a01a-1ca9b1b1104d req-1beac6fe-b02b-4afa-bb01-12413c0c08fc tempest-SecurityGroupRulesTestJSON-869214654 tempest-SecurityGroupRulesTestJSON-869214654-project-member] Enqueued Resource ID: 3a21aac2-51eb-4eef-acc2-28c7d863e8bf with Priority: HIGHEST for action security_group_rules [ 960.865995] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a21aac2-51eb-4eef-acc2-28c7d863e8bf with Priority: HIGHEST for action security_group_rules [ 960.866246] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a21aac2-51eb-4eef-acc2-28c7d863e8bf taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.866403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a21aac2-51eb-4eef-acc2-28c7d863e8bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.866491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a21aac2-51eb-4eef-acc2-28c7d863e8bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.866784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a21aac2-51eb-4eef-acc2-28c7d863e8bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.866871] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a21aac2-51eb-4eef-acc2-28c7d863e8bf',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.219839] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.223520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.223520] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.223520] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75a2bad8-adcd-4f47-8cfa-56281a1deddd with status ACTIVE [ 961.223520] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.223520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.223520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.223520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.223520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.223520] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.223520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.223520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.223520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.223520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.223520] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.223520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.223520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.228619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.228619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.228619] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75a2bad8-adcd-4f47-8cfa-56281a1deddd is going to be updated. [ 961.252607] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.252774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.252847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.253113] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.253264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.253435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75a2bad8-adcd-4f47-8cfa-56281a1deddd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.396564] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.396564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.396564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.396564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.396564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.396564] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a21aac2-51eb-4eef-acc2-28c7d863e8bf already deleted. [ 961.396564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a21aac2-51eb-4eef-acc2-28c7d863e8bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.468181] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 961.468490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.469693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.469693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.469693] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.469693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.469693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.469693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.469693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.469693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.469693] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.731180] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.973895] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.974142] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.974221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.974580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.974688] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.974849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.974978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.975239] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.975371] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.975496] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.975681] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.975812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.975883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.976090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.976298] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.976514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.976514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.977237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.977237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.977237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.977237] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.235229] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.235477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.235850] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.236612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.236612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.236612] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be created. [ 962.266152] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.266152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.266452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.266452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.268758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.278646] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: UNINITIALIZED for 2s [ 962.479759] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52023f52-3978-48e2-8510-00221c047d2e: rpc.has_security_group_logging(os_id): False [ 962.499095] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.499095] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.499095] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.499552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.518903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.520778] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.520935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.520935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.521173] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.521374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.521545] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.521682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.521751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.521909] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.522040] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.522303] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.522446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.522505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.522609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.522691] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.522778] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 962.631924] env[70535]: INFO networking_nsxv3.common.synchronization [req-747c57bc-bbd3-4670-957e-923b0bd43f10 req-68855606-df28-40fd-9e30-fc56a85dcbf7 tempest-SecurityGroupRulesTestJSON-869214654 tempest-SecurityGroupRulesTestJSON-869214654-project-member] Enqueued Resource ID: 560505b5-aa26-44ce-8229-d8c90b13fca0 with Priority: HIGHEST for action security_group_rules [ 962.635857] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 560505b5-aa26-44ce-8229-d8c90b13fca0 with Priority: HIGHEST for action security_group_rules [ 962.636744] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-560505b5-aa26-44ce-8229-d8c90b13fca0 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.636900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-560505b5-aa26-44ce-8229-d8c90b13fca0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.636968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-560505b5-aa26-44ce-8229-d8c90b13fca0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.637289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-560505b5-aa26-44ce-8229-d8c90b13fca0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.637381] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('560505b5-aa26-44ce-8229-d8c90b13fca0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.702632] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.702860] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.702956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.703185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.703360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.709024] env[70535]: INFO networking_nsxv3.common.synchronization [req-d2f742d5-734d-4217-a36f-db02940f0395 req-0eac102f-ee12-4f88-b142-378cb4b96060 tempest-ImagesOneServerTestJSON-2067594152 tempest-ImagesOneServerTestJSON-2067594152-project-member] Enqueued Resource ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 with Priority: HIGHEST for action security_group_members [ 962.709385] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 with Priority: HIGHEST for action security_group_members [ 962.709539] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.709659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.709724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.709980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.710379] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.712910] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.712910] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.712910] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.712910] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.712910] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ebf2f9b-61f1-41ce-8d01-84394f8e9115',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.723906] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 962.988233] env[70535]: INFO networking_nsxv3.common.synchronization [req-a4aa627c-dece-4c46-99f4-7131803927af req-4ae326f1-dd9a-49a4-950a-2d0e3d5d86ea tempest-SecurityGroupRulesTestJSON-869214654 tempest-SecurityGroupRulesTestJSON-869214654-project-member] Enqueued Resource ID: 560505b5-aa26-44ce-8229-d8c90b13fca0 with Priority: HIGHEST for action security_group_rules [ 962.989118] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 560505b5-aa26-44ce-8229-d8c90b13fca0 with Priority: HIGHEST for action security_group_rules [ 962.991522] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-560505b5-aa26-44ce-8229-d8c90b13fca0 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.991522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-560505b5-aa26-44ce-8229-d8c90b13fca0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.161873] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.162149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.162311] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.162551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.162646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.162809] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 560505b5-aa26-44ce-8229-d8c90b13fca0 already deleted. [ 963.162865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-560505b5-aa26-44ce-8229-d8c90b13fca0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.163025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-560505b5-aa26-44ce-8229-d8c90b13fca0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.163162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-560505b5-aa26-44ce-8229-d8c90b13fca0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.163250] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('560505b5-aa26-44ce-8229-d8c90b13fca0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.216387] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.216557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.216629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.216852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.217167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.217430] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.217537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.217628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.219849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.220424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.220822] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 already deleted. [ 963.221693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.367987] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-464 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.368781] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-464" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.369146] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-464" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.369624] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-464" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.370352] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.372313] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.372313] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.372313] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.372313] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.372313] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.372313] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.372313] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.372313] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.373369] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.373644] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.374025] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.377794] env[70535]: INFO networking_nsxv3.common.synchronization [req-99cbd8c6-a270-4e60-b8c2-a5b0262abb19 req-f7fd8d39-537b-43ab-a25e-d0ab570d3c0f tempest-SecurityGroupRulesTestJSON-869214654 tempest-SecurityGroupRulesTestJSON-869214654-project-member] Enqueued Resource ID: 560505b5-aa26-44ce-8229-d8c90b13fca0 with Priority: HIGHEST for action security_group_rules [ 963.379911] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 560505b5-aa26-44ce-8229-d8c90b13fca0 with Priority: HIGHEST for action security_group_rules [ 963.379911] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-560505b5-aa26-44ce-8229-d8c90b13fca0 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.379911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-560505b5-aa26-44ce-8229-d8c90b13fca0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.402513] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.403183] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 963.403382] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.403590] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-464" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.404020] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-38250e10-8b1b-4900-a4be-55f73835fd65 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.404282] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-38250e10-8b1b-4900-a4be-55f73835fd65" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.404411] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-38250e10-8b1b-4900-a4be-55f73835fd65" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.408026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-38250e10-8b1b-4900-a4be-55f73835fd65" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.408026] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38250e10-8b1b-4900-a4be-55f73835fd65',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.688453] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.688453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.688453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.688453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.688453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.688453] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 560505b5-aa26-44ce-8229-d8c90b13fca0 already deleted. [ 963.688453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-560505b5-aa26-44ce-8229-d8c90b13fca0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.688453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-560505b5-aa26-44ce-8229-d8c90b13fca0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.688453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-560505b5-aa26-44ce-8229-d8c90b13fca0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.688453] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('560505b5-aa26-44ce-8229-d8c90b13fca0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.910776] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.911106] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.912039] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.912039] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.912039] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.912319] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 38250e10-8b1b-4900-a4be-55f73835fd65 not found, creating... [ 963.912389] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.912564] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.912689] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.913166] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.913246] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.913564] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.913646] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.913767] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.914014] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.914356] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.914356] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 38250e10-8b1b-4900-a4be-55f73835fd65 is going to be created. [ 963.937979] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.938297] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.938504] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.938838] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.939146] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.939445] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-38250e10-8b1b-4900-a4be-55f73835fd65" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.212280] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.212681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.212681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.212815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.212815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.212904] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 560505b5-aa26-44ce-8229-d8c90b13fca0 already deleted. [ 964.213044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-560505b5-aa26-44ce-8229-d8c90b13fca0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.290528] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 964.290674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.290835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.291078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.291300] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.291400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.291459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.291622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.291703] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.291792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.291873] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.741070] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 964.741431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.794908] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.794908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.794908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.795156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.795156] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.795295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.795295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.796386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.796386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.796386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.796386] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.796386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.796386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.798023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.798023] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.798023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.799250] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.799380] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.801681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.801681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.801681] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.824076] env[70535]: INFO networking_nsxv3.common.synchronization [req-d2f742d5-734d-4217-a36f-db02940f0395 req-98969f64-52ca-440f-929c-1be7a06c2956 service nova] Enqueued Resource ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 with Priority: HIGHEST for action security_group_rules [ 964.824295] env[70535]: INFO networking_nsxv3.common.synchronization [req-d2f742d5-734d-4217-a36f-db02940f0395 req-98969f64-52ca-440f-929c-1be7a06c2956 service nova] Enqueued Resource ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 with Priority: HIGHEST for action security_group_members [ 964.824438] env[70535]: INFO networking_nsxv3.common.synchronization [req-d2f742d5-734d-4217-a36f-db02940f0395 req-98969f64-52ca-440f-929c-1be7a06c2956 service nova] Enqueued Resource ID: 38250e10-8b1b-4900-a4be-55f73835fd65 with Priority: HIGHEST for action port [ 964.825132] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 with Priority: HIGHEST for action security_group_rules [ 964.826169] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 with Priority: HIGHEST for action security_group_members [ 964.826379] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38250e10-8b1b-4900-a4be-55f73835fd65 with Priority: HIGHEST for action port [ 964.827058] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ebf2f9b-61f1-41ce-8d01-84394f8e9115 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.827377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.827482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.828081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.828214] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ebf2f9b-61f1-41ce-8d01-84394f8e9115',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.829742] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.829909] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.830124] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.830514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.831181] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.831525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.831525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.831525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.832527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.832823] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ebf2f9b-61f1-41ce-8d01-84394f8e9115',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.834513] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-38250e10-8b1b-4900-a4be-55f73835fd65 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.834637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38250e10-8b1b-4900-a4be-55f73835fd65" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.835133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38250e10-8b1b-4900-a4be-55f73835fd65" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.835133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38250e10-8b1b-4900-a4be-55f73835fd65" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.835133] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38250e10-8b1b-4900-a4be-55f73835fd65',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.304698] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9eeea75-d1ec-4e08-9721-eccdc9dae25f: rpc.has_security_group_logging(os_id): False [ 965.314329] env[70535]: INFO networking_nsxv3.common.synchronization [req-e6a72e02-fe4c-40e7-bdf6-16b08b58934f req-43ec9020-f7ed-404f-a9b8-7a7a38e3ba12 tempest-ServersAdminTestJSON-1221450413 tempest-ServersAdminTestJSON-1221450413-project-member] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 965.315491] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 965.316649] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.317124] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.317386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.317690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.318042] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.318295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.318445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.318708] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.320161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.320161] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.326883] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.326883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.326883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.327105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.327105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.327347] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.327536] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.327606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.327786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.327869] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.331028] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.331028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.331028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.331028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.331028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.331028] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.331028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.331028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.331028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.331028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.331028] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be created. [ 965.337191] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ebf2f9b-61f1-41ce-8d01-84394f8e9115',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.338141] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.338326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.339566] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38250e10-8b1b-4900-a4be-55f73835fd65 with status ACTIVE [ 965.339784] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.339908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.339978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.340281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.340384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.340688] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.340805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.340864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.341164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.341164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.341372] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.341478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.341547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.342821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.342919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.345070] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38250e10-8b1b-4900-a4be-55f73835fd65 is going to be updated. [ 965.374461] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.374461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.374461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.374461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.374653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.374682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38250e10-8b1b-4900-a4be-55f73835fd65" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.423465] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.423695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.423766] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.424141] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.424343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.456624] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 965.822682] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.843087] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ebf2f9b-61f1-41ce-8d01-84394f8e9115',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.227376] env[70535]: INFO networking_nsxv3.common.synchronization [None req-cd75e69a-c371-43a0-8da6-f6b1202ca4df tempest-ServerDiskConfigTestJSON-1021082095 tempest-ServerDiskConfigTestJSON-1021082095-project-member] Enqueued Resource ID: db8eae8e-0070-45f0-a43a-17f6bdbfd374 with Priority: HIGHEST for action security_group_rules [ 966.228225] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db8eae8e-0070-45f0-a43a-17f6bdbfd374 with Priority: HIGHEST for action security_group_rules [ 966.228702] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db8eae8e-0070-45f0-a43a-17f6bdbfd374 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.228793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db8eae8e-0070-45f0-a43a-17f6bdbfd374" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.228884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db8eae8e-0070-45f0-a43a-17f6bdbfd374" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.229238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db8eae8e-0070-45f0-a43a-17f6bdbfd374" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.229879] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db8eae8e-0070-45f0-a43a-17f6bdbfd374',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.325020] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.343278] env[70535]: INFO networking_nsxv3.common.synchronization [None req-f848f445-949d-4b15-a5b1-2a07b99d66db tempest-ServerDiskConfigTestJSON-1021082095 tempest-ServerDiskConfigTestJSON-1021082095-project-member] Enqueued Resource ID: db8eae8e-0070-45f0-a43a-17f6bdbfd374 with Priority: HIGHEST for action security_group_rules [ 966.343617] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db8eae8e-0070-45f0-a43a-17f6bdbfd374 with Priority: HIGHEST for action security_group_rules [ 966.343926] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db8eae8e-0070-45f0-a43a-17f6bdbfd374 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.344221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db8eae8e-0070-45f0-a43a-17f6bdbfd374" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.347696] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.347874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.347874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.348114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.348205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.348296] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 is going to be created. [ 966.374610] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.374610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.374610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.374610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.374610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.386453] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 in Status: UNINITIALIZED for 2s [ 966.753218] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.753218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.753218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.753218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.753218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.753218] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db8eae8e-0070-45f0-a43a-17f6bdbfd374 already deleted. [ 966.753218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db8eae8e-0070-45f0-a43a-17f6bdbfd374" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.753218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db8eae8e-0070-45f0-a43a-17f6bdbfd374" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.753654] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db8eae8e-0070-45f0-a43a-17f6bdbfd374" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.753654] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db8eae8e-0070-45f0-a43a-17f6bdbfd374',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.827751] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.828064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.828064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.828187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.828275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.828399] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be updated. [ 966.874536] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.874726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.874769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.875084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.875348] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.895168] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: IN_PROGRESS for 2s [ 967.278922] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.279091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.279163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.279519] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.279618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.279719] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db8eae8e-0070-45f0-a43a-17f6bdbfd374 already deleted. [ 967.279802] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db8eae8e-0070-45f0-a43a-17f6bdbfd374" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.469995] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 967.470259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.178134] env[70535]: INFO networking_nsxv3.common.synchronization [req-5f59e87f-f1fd-4d83-991e-f51619cc0a1d req-d13687be-997c-43cc-a51d-0807063ccce8 tempest-VolumesAdminNegativeTest-1297223157 tempest-VolumesAdminNegativeTest-1297223157-project-member] Enqueued Resource ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b with Priority: HIGHEST for action security_group_members [ 968.181364] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b with Priority: HIGHEST for action security_group_members [ 968.181364] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cf5479f-0fc2-40f1-871d-b049fdff299b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.181364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.181364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.181364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.181364] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.181364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.181364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.181364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.181364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.181364] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cf5479f-0fc2-40f1-871d-b049fdff299b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.397961] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 in Status: SUCCESS [ 968.398322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.398524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.398751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.398960] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.399110] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.399181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.399365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.399455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.399545] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.399693] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ebf2f9b-61f1-41ce-8d01-84394f8e9115',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.685922] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.686186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.686263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.686481] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.686793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.686793] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.686925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.686989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.687187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.687283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.687368] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b already deleted. [ 968.687450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.704936] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-339 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.706284] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-339" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.706284] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-339" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.706284] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-339" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.706769] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.707089] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.707284] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.707679] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.707851] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.708116] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 968.708269] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.708410] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.708527] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.710024] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 968.710024] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.710024] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.731541] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.731758] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 968.731909] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.732264] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-339" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.732463] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-52dee7d2-c471-4a40-8c51-b1fb08e40d4e taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.732646] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-52dee7d2-c471-4a40-8c51-b1fb08e40d4e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.733169] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-52dee7d2-c471-4a40-8c51-b1fb08e40d4e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.733795] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-52dee7d2-c471-4a40-8c51-b1fb08e40d4e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.733917] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52dee7d2-c471-4a40-8c51-b1fb08e40d4e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.905666] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.905666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.905941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.905941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.906269] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.906397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.906397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.906519] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.906611] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.906697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.906904] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.907028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.907102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.907233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.907374] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.907495] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.907556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.907718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.907799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.907901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.907963] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ebf2f9b-61f1-41ce-8d01-84394f8e9115',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.910969] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 968.911277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.238312] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.238654] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.238788] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.239257] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.239466] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.239651] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 52dee7d2-c471-4a40-8c51-b1fb08e40d4e not found, creating... [ 969.239958] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.240213] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.240539] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.240919] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.241215] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.241701] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.241896] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.242054] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.242355] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.242553] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.242738] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 52dee7d2-c471-4a40-8c51-b1fb08e40d4e is going to be created. [ 969.266516] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.266819] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.267077] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.267620] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.267717] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.268781] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-52dee7d2-c471-4a40-8c51-b1fb08e40d4e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.413086] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ebf2f9b-61f1-41ce-8d01-84394f8e9115: rpc.has_security_group_logging(os_id): False [ 969.445927] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.445927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.445927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.445927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.445927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.445927] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.445927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.445927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.450493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.450493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.450493] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.450493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.450493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.450493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.450493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.450493] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.450493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.450493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.450493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.450493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.450493] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 is going to be created. [ 969.539991] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.539991] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.539991] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.539991] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.539991] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.560409] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 in Status: IN_PROGRESS for 2s [ 970.348120] env[70535]: INFO networking_nsxv3.common.synchronization [req-5f59e87f-f1fd-4d83-991e-f51619cc0a1d req-075e4e44-8e6e-4bf2-9a39-6f16da795ea7 service nova] Enqueued Resource ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b with Priority: HIGHEST for action security_group_rules [ 970.348120] env[70535]: INFO networking_nsxv3.common.synchronization [req-5f59e87f-f1fd-4d83-991e-f51619cc0a1d req-075e4e44-8e6e-4bf2-9a39-6f16da795ea7 service nova] Enqueued Resource ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b with Priority: HIGHEST for action security_group_members [ 970.348120] env[70535]: INFO networking_nsxv3.common.synchronization [req-5f59e87f-f1fd-4d83-991e-f51619cc0a1d req-075e4e44-8e6e-4bf2-9a39-6f16da795ea7 service nova] Enqueued Resource ID: 52dee7d2-c471-4a40-8c51-b1fb08e40d4e with Priority: HIGHEST for action port [ 970.348120] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b with Priority: HIGHEST for action security_group_rules [ 970.348120] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b with Priority: HIGHEST for action security_group_members [ 970.348120] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52dee7d2-c471-4a40-8c51-b1fb08e40d4e with Priority: HIGHEST for action port [ 970.348120] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cf5479f-0fc2-40f1-871d-b049fdff299b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.348120] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.348120] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.348120] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.348120] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cf5479f-0fc2-40f1-871d-b049fdff299b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.348891] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cf5479f-0fc2-40f1-871d-b049fdff299b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.348993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.348993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.349314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.349314] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.349448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.349609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.349642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.349725] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.349816] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cf5479f-0fc2-40f1-871d-b049fdff299b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.351484] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-52dee7d2-c471-4a40-8c51-b1fb08e40d4e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.351642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52dee7d2-c471-4a40-8c51-b1fb08e40d4e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.351642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52dee7d2-c471-4a40-8c51-b1fb08e40d4e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.354181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52dee7d2-c471-4a40-8c51-b1fb08e40d4e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.354181] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52dee7d2-c471-4a40-8c51-b1fb08e40d4e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.854034] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cf5479f-0fc2-40f1-871d-b049fdff299b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.854351] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.854745] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cf5479f-0fc2-40f1-871d-b049fdff299b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.855700] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52dee7d2-c471-4a40-8c51-b1fb08e40d4e with status ACTIVE [ 970.855918] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.856167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.856298] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.856564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.856665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.856865] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.856980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.857436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.857737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.857808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.858219] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.858462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.858562] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.858844] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.858844] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.858957] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52dee7d2-c471-4a40-8c51-b1fb08e40d4e is going to be updated. [ 970.958744] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.958744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.958744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.958744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.958744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.958744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52dee7d2-c471-4a40-8c51-b1fb08e40d4e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.985699] env[70535]: INFO networking_nsxv3.common.synchronization [None req-f48056d4-57c9-4755-95a9-c8a237887070 None None] Enqueued Resource ID: 06fe0b3f-818a-46df-add9-34b15887071c with Priority: HIGHEST for action port [ 970.986493] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06fe0b3f-818a-46df-add9-34b15887071c with Priority: HIGHEST for action port [ 970.986944] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-06fe0b3f-818a-46df-add9-34b15887071c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.990010] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06fe0b3f-818a-46df-add9-34b15887071c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.990010] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06fe0b3f-818a-46df-add9-34b15887071c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.990010] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06fe0b3f-818a-46df-add9-34b15887071c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.990010] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06fe0b3f-818a-46df-add9-34b15887071c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.134938] env[70535]: INFO networking_nsxv3.common.synchronization [req-b2daed49-b17a-4007-903b-4224a83bc28b req-0944e3b2-62ad-4142-b97d-76a58595c8de tempest-ServerDiskConfigTestJSON-1021082095 tempest-ServerDiskConfigTestJSON-1021082095-project-member] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 971.135517] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 971.135834] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.135956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.136366] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.137201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.137441] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.137674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.137977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.137977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.139138] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.139353] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.360823] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cf5479f-0fc2-40f1-871d-b049fdff299b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.493487] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06fe0b3f-818a-46df-add9-34b15887071c [ 971.493708] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.493823] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.493967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.494278] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.494772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.494772] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06fe0b3f-818a-46df-add9-34b15887071c already deleted. [ 971.494772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06fe0b3f-818a-46df-add9-34b15887071c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.583706] env[70535]: INFO networking_nsxv3.common.synchronization [req-d163d04d-65d4-498d-92c5-6409b928b40e req-b1871e9c-2d04-4e0b-9697-30cc279c6bdf tempest-ServersWithSpecificFlavorTestJSON-86157586 tempest-ServersWithSpecificFlavorTestJSON-86157586-project-member] Enqueued Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_members [ 971.585406] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 in Status: SUCCESS [ 971.585846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.586235] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGHEST for action security_group_members [ 971.586696] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b3e2660-4c57-4d95-a486-449e2bf37488 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.586968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.587215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.588721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.588721] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.588721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.588721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.588721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.588721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.588721] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.642091] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.642350] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.642350] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.642561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.679695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.680014] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.680223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.680303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.680529] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.680617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.680713] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 971.717553] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.717726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.717797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.718014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.718168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.727776] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 971.867621] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.868570] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.870250] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.870492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.870597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.870705] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b is going to be created. [ 971.905138] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.906094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.906094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.906513] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.906587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.925293] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b in Status: UNINITIALIZED for 2s [ 972.004035] env[70535]: INFO networking_nsxv3.common.synchronization [req-9a2d7cd2-1d08-4cb5-b4ea-80eef00b2256 req-8683ce35-b9d8-488a-a568-4c758b0061d0 tempest-DeleteServersTestJSON-660883378 tempest-DeleteServersTestJSON-660883378-project-member] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 972.004608] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 972.005087] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.005087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.005258] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.005410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.005477] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.005596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.005654] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.005771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.005857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.006020] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.094045] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.094045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.094045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.094045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.094045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.094045] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.094045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.094045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.094045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.094045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.094045] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 is going to be updated. [ 972.127139] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.127139] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.127139] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.127139] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.127139] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.136497] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 in Status: IN_PROGRESS for 2s [ 972.509955] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.509955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.511208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.511552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.511622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.511827] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.511937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.512013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.512230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.512311] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.512403] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 972.547906] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.548092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.548179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.548471] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.549032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.558393] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 973.057421] env[70535]: INFO networking_nsxv3.common.synchronization [None req-6f92c5ff-9bd3-4c09-a323-a0b3847e6746 None None] Enqueued Resource ID: 8dd15c53-4b96-4763-9bcc-dfedeccde7f4 with Priority: HIGHEST for action port [ 973.057699] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dd15c53-4b96-4763-9bcc-dfedeccde7f4 with Priority: HIGHEST for action port [ 973.058286] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dd15c53-4b96-4763-9bcc-dfedeccde7f4 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.060238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dd15c53-4b96-4763-9bcc-dfedeccde7f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.060238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dd15c53-4b96-4763-9bcc-dfedeccde7f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.060238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dd15c53-4b96-4763-9bcc-dfedeccde7f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.060238] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dd15c53-4b96-4763-9bcc-dfedeccde7f4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.561640] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8dd15c53-4b96-4763-9bcc-dfedeccde7f4 [ 973.562046] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.562046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.562046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.562252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.562340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.562446] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8dd15c53-4b96-4763-9bcc-dfedeccde7f4 already deleted. [ 973.562560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dd15c53-4b96-4763-9bcc-dfedeccde7f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.740022] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 973.740361] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 deletion is rescheduled due to dependency. [ 973.740493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.935448] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b in Status: SUCCESS [ 973.935687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.935858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.936034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.936256] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.936376] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.936437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.936603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.936685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.936771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.936860] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cf5479f-0fc2-40f1-871d-b049fdff299b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.147106] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 in Status: SUCCESS [ 974.147106] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 deletion is rescheduled due to dependency. [ 974.147256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.439627] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cf5479f-0fc2-40f1-871d-b049fdff299b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.439968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.440149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.440514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.440791] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.440984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.441138] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.441452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.441647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.441846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.442146] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cf5479f-0fc2-40f1-871d-b049fdff299b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.442318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.442455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.442748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.442986] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.443181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.443301] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.443574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.443741] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.443897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.444108] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cf5479f-0fc2-40f1-871d-b049fdff299b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.568988] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 974.569402] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f deletion is rescheduled due to dependency. [ 974.569402] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.821073] env[70535]: INFO networking_nsxv3.common.synchronization [req-b721d860-27c5-404a-9524-dc933c88ebb0 req-26d82f58-0989-43f4-8850-fab34ab7a998 tempest-ServerTagsTestJSON-208557757 tempest-ServerTagsTestJSON-208557757-project-member] Enqueued Resource ID: 38f24a1f-1902-4055-9039-309e33c0499b with Priority: HIGHEST for action security_group_members [ 974.821675] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38f24a1f-1902-4055-9039-309e33c0499b with Priority: HIGHEST for action security_group_members [ 974.822463] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-38f24a1f-1902-4055-9039-309e33c0499b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.822601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.822672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.822933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.823112] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.823217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.823280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.823435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.823524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.823617] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38f24a1f-1902-4055-9039-309e33c0499b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.939745] env[70535]: INFO networking_nsxv3.common.synchronization [req-9cbf7468-1cba-4744-85e7-4c2e09315b8d req-8a35f00f-b637-467a-9f41-c056076414dd tempest-ImagesTestJSON-1564979202 tempest-ImagesTestJSON-1564979202-project-member] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 974.940317] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 974.940641] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.940768] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.940849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.941309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.941477] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.941628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.941686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.941937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.942014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.942083] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.946552] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cf5479f-0fc2-40f1-871d-b049fdff299b: rpc.has_security_group_logging(os_id): False [ 974.968519] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.968696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.968795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.969064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.969168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.969441] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.969657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.969657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.969832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.969931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.970188] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.970304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.970370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.970540] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.970630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.970853] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.970954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.971045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.971220] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.971321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.971430] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b is going to be created. [ 975.061773] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.061921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.062059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.062240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.062430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.074547] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b in Status: IN_PROGRESS for 2s [ 975.258011] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.258258] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-156" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.258394] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-156" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.258780] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-156" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.259210] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.259340] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.259470] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.259775] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.259941] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.260181] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 975.260301] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 975.260428] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 975.260568] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 975.260686] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 975.260903] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 975.260957] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 975.280803] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 975.281075] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 975.281239] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 975.281443] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-156" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.281840] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.282025] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.282196] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.282617] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.282799] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.326514] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.326514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.326514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.326514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.326514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.327219] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.327219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.327219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.327219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.327219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.327219] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38f24a1f-1902-4055-9039-309e33c0499b already deleted. [ 975.327558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.445323] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.786042] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.786396] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.786396] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.786802] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.786802] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.786881] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee not found, creating... [ 975.787197] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.787459] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.787647] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.787980] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.788240] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.788706] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.788933] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.789084] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.789306] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.789452] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.789596] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee is going to be created. [ 975.823753] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.823969] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.824027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.824460] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.824709] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.825052] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.948193] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.450485] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.450675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.450732] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.450920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.451029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.451138] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 976.482265] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.482425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.482606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.482673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.482820] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.491862] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 976.596681] env[70535]: INFO networking_nsxv3.common.synchronization [req-b721d860-27c5-404a-9524-dc933c88ebb0 req-e609d158-dd6f-40ec-9d14-60353b5b2862 service nova] Enqueued Resource ID: 38f24a1f-1902-4055-9039-309e33c0499b with Priority: HIGHEST for action security_group_rules [ 976.596965] env[70535]: INFO networking_nsxv3.common.synchronization [req-b721d860-27c5-404a-9524-dc933c88ebb0 req-e609d158-dd6f-40ec-9d14-60353b5b2862 service nova] Enqueued Resource ID: 38f24a1f-1902-4055-9039-309e33c0499b with Priority: HIGHEST for action security_group_members [ 976.597132] env[70535]: INFO networking_nsxv3.common.synchronization [req-b721d860-27c5-404a-9524-dc933c88ebb0 req-e609d158-dd6f-40ec-9d14-60353b5b2862 service nova] Enqueued Resource ID: 3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee with Priority: HIGHEST for action port [ 976.599027] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38f24a1f-1902-4055-9039-309e33c0499b with Priority: HIGHEST for action security_group_rules [ 976.599027] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38f24a1f-1902-4055-9039-309e33c0499b with Priority: HIGHEST for action security_group_members [ 976.599027] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee with Priority: HIGHEST for action port [ 976.599027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38f24a1f-1902-4055-9039-309e33c0499b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.599027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.599027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.599507] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.599507] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38f24a1f-1902-4055-9039-309e33c0499b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.600056] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-38f24a1f-1902-4055-9039-309e33c0499b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.600189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.601018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.601018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.601018] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.601018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.601018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.601018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.601018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.601018] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38f24a1f-1902-4055-9039-309e33c0499b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.604587] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.604587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.604587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.604587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.604587] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.090790] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b in Status: SUCCESS [ 977.090790] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.104693] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-38f24a1f-1902-4055-9039-309e33c0499b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.104799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.105628] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38f24a1f-1902-4055-9039-309e33c0499b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.105894] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee with status ACTIVE [ 977.106108] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.106296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.106363] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.106600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.106712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.106825] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.106935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.106983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.107207] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.107207] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.107381] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.107473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.107528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.107670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.107745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.107828] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee is going to be updated. [ 977.129084] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.129260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.129323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.129501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.129635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.129796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3008dcaf-cbd5-4d44-bfa0-2922d87ad4ee" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.610067] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38f24a1f-1902-4055-9039-309e33c0499b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.112893] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.113225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.113268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.113495] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.113621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.113748] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38f24a1f-1902-4055-9039-309e33c0499b is going to be created. [ 978.137507] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.137652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.137725] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.137937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.138115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.148970] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38f24a1f-1902-4055-9039-309e33c0499b in Status: UNINITIALIZED for 2s [ 978.503129] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 978.503268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.161983] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38f24a1f-1902-4055-9039-309e33c0499b in Status: SUCCESS [ 980.295772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.295772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.295772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.295772] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.295772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.295772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.295772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.295772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.295772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.295772] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38f24a1f-1902-4055-9039-309e33c0499b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.666408] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-38f24a1f-1902-4055-9039-309e33c0499b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.666620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.666700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.667050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.667355] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.667479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.667555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.667726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.667936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.667936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.668086] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-38f24a1f-1902-4055-9039-309e33c0499b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.668164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.668245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.668393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.668509] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.668606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.668677] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.668852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.669113] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.669113] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.669113] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38f24a1f-1902-4055-9039-309e33c0499b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.175090] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38f24a1f-1902-4055-9039-309e33c0499b: rpc.has_security_group_logging(os_id): False [ 981.191970] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.192196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.192196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.192417] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.192542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.192779] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.192897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.192975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.193199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.193328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.193548] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.193667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.193760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.193935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.194041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.194261] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.194373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.194450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.194620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.194714] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.194823] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38f24a1f-1902-4055-9039-309e33c0499b is going to be created. [ 981.249619] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.249819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.249819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.250057] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.250283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.260887] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38f24a1f-1902-4055-9039-309e33c0499b in Status: IN_PROGRESS for 2s [ 981.600394] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 981.600394] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 981.680227] env[70535]: INFO networking_nsxv3.common.synchronization [req-18cd65cb-5032-4b65-980d-42d28ee18197 req-b3af4580-65f1-4744-83ac-933ab094231e tempest-ServersNegativeTestJSON-1344173276 tempest-ServersNegativeTestJSON-1344173276-project-member] Enqueued Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_members [ 981.680506] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_members [ 981.681137] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.681285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.681332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.681603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.681768] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.681874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.681938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.682136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.682225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.682316] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.126981] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-421 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.127151] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-421" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.127332] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-421" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.127682] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-421" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.127996] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.128191] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.128325] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.128574] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.128734] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.128956] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 982.129114] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 982.129233] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 982.129344] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 982.129468] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 982.129592] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 982.129733] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 982.160029] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 982.160314] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 982.160419] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 982.164044] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-421" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.164446] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-e65cbbde-c297-4cd7-9d53-2c6757df2e11 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.164650] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-e65cbbde-c297-4cd7-9d53-2c6757df2e11" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.164779] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-e65cbbde-c297-4cd7-9d53-2c6757df2e11" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.165162] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-e65cbbde-c297-4cd7-9d53-2c6757df2e11" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.165312] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e65cbbde-c297-4cd7-9d53-2c6757df2e11',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.184505] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.668340] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.668578] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.668696] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.668995] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.669171] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.669329] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port e65cbbde-c297-4cd7-9d53-2c6757df2e11 not found, creating... [ 982.669594] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.669759] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.669880] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.670116] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.670261] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.670548] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.670709] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.670829] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.671274] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.671274] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.671382] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: e65cbbde-c297-4cd7-9d53-2c6757df2e11 is going to be created. [ 982.687556] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.693011] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.693011] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.693011] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.693011] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.693011] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.693011] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-e65cbbde-c297-4cd7-9d53-2c6757df2e11" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.190238] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.190639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.190639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.191646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.191723] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.191871] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 is going to be updated. [ 983.222900] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.223169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.223169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.223330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.223472] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.237267] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: IN_PROGRESS for 2s [ 983.272468] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38f24a1f-1902-4055-9039-309e33c0499b in Status: SUCCESS [ 983.273214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.443289] env[70535]: INFO networking_nsxv3.common.synchronization [req-18cd65cb-5032-4b65-980d-42d28ee18197 req-78f3a08e-d818-43e7-a5dc-6ad90985c041 service nova] Enqueued Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_rules [ 983.443289] env[70535]: INFO networking_nsxv3.common.synchronization [req-18cd65cb-5032-4b65-980d-42d28ee18197 req-78f3a08e-d818-43e7-a5dc-6ad90985c041 service nova] Enqueued Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_members [ 983.443289] env[70535]: INFO networking_nsxv3.common.synchronization [req-18cd65cb-5032-4b65-980d-42d28ee18197 req-78f3a08e-d818-43e7-a5dc-6ad90985c041 service nova] Enqueued Resource ID: e65cbbde-c297-4cd7-9d53-2c6757df2e11 with Priority: HIGHEST for action port [ 983.443289] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_rules [ 983.443289] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_members [ 983.443289] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e65cbbde-c297-4cd7-9d53-2c6757df2e11 with Priority: HIGHEST for action port [ 983.443846] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.444110] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.444325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.444696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.444917] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.446094] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.446361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.446713] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-e65cbbde-c297-4cd7-9d53-2c6757df2e11 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.446950] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e65cbbde-c297-4cd7-9d53-2c6757df2e11" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.448017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e65cbbde-c297-4cd7-9d53-2c6757df2e11" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.448017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e65cbbde-c297-4cd7-9d53-2c6757df2e11" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.448017] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e65cbbde-c297-4cd7-9d53-2c6757df2e11',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.950550] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.950683] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.950878] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e65cbbde-c297-4cd7-9d53-2c6757df2e11 with status ACTIVE [ 983.951058] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.951216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.951289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.951444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.951540] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.951731] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.951788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.951850] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.952010] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.952095] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.952271] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.952394] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.952444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.952555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.952631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.952713] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e65cbbde-c297-4cd7-9d53-2c6757df2e11 is going to be updated. [ 983.974673] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.974920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.974920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.975115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.975252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.975414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e65cbbde-c297-4cd7-9d53-2c6757df2e11" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.249675] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: SUCCESS [ 985.249951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.250200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.250455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.250677] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.251048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.251048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.251130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.251189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.251335] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.754260] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.225686] env[70535]: INFO networking_nsxv3.common.synchronization [req-b6ea7508-2044-47c4-94a2-692afb3d3fe4 req-09b759f1-4696-429b-bfa5-e538fc69055c tempest-VolumesAdminNegativeTest-1297223157 tempest-VolumesAdminNegativeTest-1297223157-project-member] Enqueued Resource ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b with Priority: HIGHEST for action security_group_members [ 986.227023] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b with Priority: HIGHEST for action security_group_members [ 986.227023] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cf5479f-0fc2-40f1-871d-b049fdff299b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.231246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.231246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.231246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.231246] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.231246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.231246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.231246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.231246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.231246] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cf5479f-0fc2-40f1-871d-b049fdff299b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.258899] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.734053] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.734053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.734259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.734531] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.734693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.734989] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.735158] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.735268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.735489] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.735617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.735750] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b is going to be updated. [ 986.762090] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.762256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.762373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.762632] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.762632] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.762739] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 is going to be updated. [ 986.781343] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.781637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.781719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.782156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.782338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.793025] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b in Status: IN_PROGRESS for 2s [ 986.802377] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.802602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.802762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.802863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.803096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.813735] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: IN_PROGRESS for 2s [ 988.668748] env[70535]: INFO networking_nsxv3.common.synchronization [req-f7962c32-2cad-4c3b-b9a3-ad10f07892a9 req-8c9ee13f-fc4e-4957-8e6f-4cda117f4d68 tempest-ServersAdminTestJSON-1221450413 tempest-ServersAdminTestJSON-1221450413-project-member] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 988.669381] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 988.669772] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.669896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.669960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.670193] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.671031] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.671031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.671031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.671031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.671031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.671031] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.805026] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b in Status: SUCCESS [ 988.805026] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b deletion is rescheduled due to dependency. [ 988.805026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.827326] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: SUCCESS [ 988.827689] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.828642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.828946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.831816] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.831929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.832031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.832922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.832922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.832922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.832922] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.889810] env[70535]: INFO networking_nsxv3.common.synchronization [req-65fb7e28-361f-49f2-95d9-066e2e0ae9d0 req-aba00b95-e8b3-4164-8525-a8d409597fec tempest-ServerTagsTestJSON-208557757 tempest-ServerTagsTestJSON-208557757-project-member] Enqueued Resource ID: 38f24a1f-1902-4055-9039-309e33c0499b with Priority: HIGHEST for action security_group_members [ 988.890471] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38f24a1f-1902-4055-9039-309e33c0499b with Priority: HIGHEST for action security_group_members [ 988.890711] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-38f24a1f-1902-4055-9039-309e33c0499b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.891810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.891810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.891810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.891810] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.891810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.891810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.891810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.892556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.892556] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38f24a1f-1902-4055-9039-309e33c0499b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.175530] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.336070] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.336327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.336433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.336802] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.336893] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.336951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.337027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.337223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.337444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.337444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.337581] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.337684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.337762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.337907] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.338056] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.338164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.338221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.338368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.338458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.338524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.338602] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.394669] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.394846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.394941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.395739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.395739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.395739] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.395739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.395739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.396165] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.396165] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.396165] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38f24a1f-1902-4055-9039-309e33c0499b is going to be updated. [ 989.430457] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.430692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.430944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.431237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.431391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.442253] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38f24a1f-1902-4055-9039-309e33c0499b in Status: IN_PROGRESS for 2s [ 989.678369] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.841163] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878: rpc.has_security_group_logging(os_id): False [ 989.858411] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.858564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.858727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.858918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.859013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.859259] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.859357] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.859357] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.860068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.860068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.860068] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.860068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.860068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.860068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.860068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.860332] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.860332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.860415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.860515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.860621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.860803] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 is going to be updated. [ 989.923464] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.923645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.923722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.923940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.924094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.939899] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: IN_PROGRESS for 2s [ 990.180873] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.181077] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.181167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.181369] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.181465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.181561] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be updated. [ 990.228963] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.229721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.229811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.230121] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.230287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.239451] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: IN_PROGRESS for 2s [ 991.452141] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38f24a1f-1902-4055-9039-309e33c0499b in Status: SUCCESS [ 991.452461] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38f24a1f-1902-4055-9039-309e33c0499b deletion is rescheduled due to dependency. [ 991.452461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.486183] env[70535]: INFO networking_nsxv3.common.synchronization [req-a191b2df-1bd3-438c-9423-8b50a0d3ed27 req-800b387c-5340-4c24-9b2f-6ca08fdf6db0 tempest-ServerActionsV293TestJSON-1453434710 tempest-ServerActionsV293TestJSON-1453434710-project-member] Enqueued Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGHEST for action security_group_members [ 991.486609] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGHEST for action security_group_members [ 991.487076] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9244c40-b3c3-42a1-af4b-33b8585c25ed taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.487371] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.487585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.487893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.488178] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.489650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.489650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.489650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.489650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.489650] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9244c40-b3c3-42a1-af4b-33b8585c25ed',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.892212] env[70535]: INFO networking_nsxv3.common.synchronization [req-8730df54-638f-44a0-ba6f-2b02fb575d94 req-12bb4919-35c9-4afd-888b-96837cf99991 tempest-ServerDiskConfigTestJSON-1021082095 tempest-ServerDiskConfigTestJSON-1021082095-project-member] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 991.893688] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 991.895630] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.895813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.898127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.898127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.898127] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.898127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.898127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.898127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.898127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.898127] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.963105] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: SUCCESS [ 991.963440] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.991377] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.991377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.991377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.991377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.991679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.991679] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.991769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.991807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.991956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.992074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.992165] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed is going to be updated. [ 992.025500] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.025733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.025733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.025929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.026093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.039077] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed in Status: IN_PROGRESS for 2s [ 992.250594] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 992.250819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.335678] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.335897] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.336042] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.336325] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.336664] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.336868] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.337074] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.337319] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.337483] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.337716] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 992.337841] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.337956] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.338089] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.338208] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 992.338316] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.338450] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.358829] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.359087] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 992.359258] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.359413] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.359758] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-116d10ff-43d3-4b50-bca7-c600d4c3169f taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.359943] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-116d10ff-43d3-4b50-bca7-c600d4c3169f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.360082] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-116d10ff-43d3-4b50-bca7-c600d4c3169f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.360481] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-116d10ff-43d3-4b50-bca7-c600d4c3169f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.360631] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('116d10ff-43d3-4b50-bca7-c600d4c3169f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.399595] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.399792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.399856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.400056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.400154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.400351] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.400454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.400520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.400693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.400784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.400874] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 992.429705] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.429901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.429943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.430162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.430305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.440583] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 992.777695] env[70535]: INFO networking_nsxv3.common.synchronization [req-4be69b44-3535-4322-9b02-5bfa6cb3829c req-1c1d7197-f798-46fd-b214-659f0c9b9257 tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 992.778998] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 992.779446] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.779650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.779741] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.779990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.780184] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.780324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.780403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.780610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.780729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.780880] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.864105] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.864351] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.864485] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.864779] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.864934] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.865108] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 116d10ff-43d3-4b50-bca7-c600d4c3169f not found, creating... [ 992.865375] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.865538] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.865659] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.865883] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.866552] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.866552] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.866552] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.866717] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.866814] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.866946] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.867310] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 116d10ff-43d3-4b50-bca7-c600d4c3169f is going to be created. [ 992.891034] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.891411] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.891411] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.891647] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.891883] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.892130] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-116d10ff-43d3-4b50-bca7-c600d4c3169f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.285156] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.285156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.285156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.285156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.285156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.285156] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.285156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.285156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.285156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.285156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.285156] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be deleted. [ 993.322701] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.322701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.322701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.322701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.322701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.322701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.515827] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.516511] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.516511] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.519149] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.519149] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.519149] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.519149] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.519149] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.519149] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.519383] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.519572] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.519787] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.520030] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.520453] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.520669] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.521079] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.546578] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.546786] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 993.546786] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.547128] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.547470] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-7124254d-761c-4f7c-9cd7-f6a0bed6d9bc taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.547788] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-7124254d-761c-4f7c-9cd7-f6a0bed6d9bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.547788] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-7124254d-761c-4f7c-9cd7-f6a0bed6d9bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.548156] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-7124254d-761c-4f7c-9cd7-f6a0bed6d9bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.548347] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7124254d-761c-4f7c-9cd7-f6a0bed6d9bc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.761600] env[70535]: INFO networking_nsxv3.common.synchronization [req-8730df54-638f-44a0-ba6f-2b02fb575d94 req-d082c525-4f8e-4d4d-b051-6dfa105a9589 service nova] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_rules [ 993.761600] env[70535]: INFO networking_nsxv3.common.synchronization [req-8730df54-638f-44a0-ba6f-2b02fb575d94 req-d082c525-4f8e-4d4d-b051-6dfa105a9589 service nova] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 993.761600] env[70535]: INFO networking_nsxv3.common.synchronization [req-8730df54-638f-44a0-ba6f-2b02fb575d94 req-d082c525-4f8e-4d4d-b051-6dfa105a9589 service nova] Enqueued Resource ID: 116d10ff-43d3-4b50-bca7-c600d4c3169f with Priority: HIGHEST for action port [ 993.761997] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_rules [ 993.762241] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 993.762375] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 116d10ff-43d3-4b50-bca7-c600d4c3169f with Priority: HIGHEST for action port [ 993.762805] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.762949] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.763046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.763282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.763381] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.764690] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.764895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.765402] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-116d10ff-43d3-4b50-bca7-c600d4c3169f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.765402] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-116d10ff-43d3-4b50-bca7-c600d4c3169f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.765520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-116d10ff-43d3-4b50-bca7-c600d4c3169f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.765727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-116d10ff-43d3-4b50-bca7-c600d4c3169f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.766995] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('116d10ff-43d3-4b50-bca7-c600d4c3169f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.049701] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed in Status: SUCCESS [ 994.050044] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed deletion is rescheduled due to dependency. [ 994.050044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.054030] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.054030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.054030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.054030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.054030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.054030] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 7124254d-761c-4f7c-9cd7-f6a0bed6d9bc not found, creating... [ 994.054030] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.054030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.054030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.054030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.054030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.054587] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.054587] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.054587] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.054587] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.054587] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.054587] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 7124254d-761c-4f7c-9cd7-f6a0bed6d9bc is going to be created. [ 994.079964] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.079964] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.079964] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.080226] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.080366] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.080721] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-7124254d-761c-4f7c-9cd7-f6a0bed6d9bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.265817] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.266049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.272410] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 116d10ff-43d3-4b50-bca7-c600d4c3169f with status ACTIVE [ 994.272625] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.272751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.272832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.273080] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.273176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.273358] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.273456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.273537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.273694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.273770] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.273951] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.274055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.274117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.274273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.274349] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.274447] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 116d10ff-43d3-4b50-bca7-c600d4c3169f is going to be updated. [ 994.296054] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.296285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.296355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.296680] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.296872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.297088] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-116d10ff-43d3-4b50-bca7-c600d4c3169f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.452858] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 994.453081] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 deletion is rescheduled due to dependency. [ 994.453216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.453451] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.453623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.453863] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.454009] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.454097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.454261] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.454424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.454485] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.957330] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.028221] env[70535]: INFO networking_nsxv3.common.synchronization [req-4be69b44-3535-4322-9b02-5bfa6cb3829c req-d27f357d-c08f-40c1-81ea-2bd7f0a1e6cc service nova] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_rules [ 995.028599] env[70535]: INFO networking_nsxv3.common.synchronization [req-4be69b44-3535-4322-9b02-5bfa6cb3829c req-d27f357d-c08f-40c1-81ea-2bd7f0a1e6cc service nova] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 995.029238] env[70535]: INFO networking_nsxv3.common.synchronization [req-4be69b44-3535-4322-9b02-5bfa6cb3829c req-d27f357d-c08f-40c1-81ea-2bd7f0a1e6cc service nova] Enqueued Resource ID: 7124254d-761c-4f7c-9cd7-f6a0bed6d9bc with Priority: HIGHEST for action port [ 995.033000] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_rules [ 995.033000] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 995.033000] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7124254d-761c-4f7c-9cd7-f6a0bed6d9bc with Priority: HIGHEST for action port [ 995.033000] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.033000] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.033000] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.033000] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.033000] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.033510] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.033510] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.033510] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.033621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.033910] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.033910] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.033910] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.034065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.034065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.036980] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.036980] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-7124254d-761c-4f7c-9cd7-f6a0bed6d9bc taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.036980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7124254d-761c-4f7c-9cd7-f6a0bed6d9bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.036980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7124254d-761c-4f7c-9cd7-f6a0bed6d9bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.037628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7124254d-761c-4f7c-9cd7-f6a0bed6d9bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.037628] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7124254d-761c-4f7c-9cd7-f6a0bed6d9bc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.459808] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.541078] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.542165] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.542280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.542485] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7124254d-761c-4f7c-9cd7-f6a0bed6d9bc with status ACTIVE [ 995.542610] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.542723] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.542781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.543019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.544201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.544201] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.544201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.544201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.544201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.544201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.544201] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.544201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.544201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.544201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.544613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.544613] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7124254d-761c-4f7c-9cd7-f6a0bed6d9bc is going to be updated. [ 995.574677] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.574881] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.575553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.575841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.575991] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.576186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7124254d-761c-4f7c-9cd7-f6a0bed6d9bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.963681] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.963681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.963681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.963959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.963959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.964035] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 995.999309] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.999309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.999309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.999309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.999610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.014474] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 996.047007] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.145743] env[70535]: INFO networking_nsxv3.common.synchronization [req-3228dff5-9ab0-49c0-a790-cd1274a7794a req-aa9e2b06-a4a5-42e6-a031-57ba92fb60c8 tempest-ServersNegativeTestJSON-1344173276 tempest-ServersNegativeTestJSON-1344173276-project-member] Enqueued Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_members [ 996.148213] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_members [ 996.148714] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.148995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.149194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.149607] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.149979] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.150218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.150544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.150803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.150984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.152245] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.550541] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.550541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.551140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.551140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.551140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.551140] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be created. [ 996.574745] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.574981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.575114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.575390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.575646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.588798] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: UNINITIALIZED for 2s [ 996.654076] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.156714] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.660170] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.660170] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.660576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.660576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.660669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.660790] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 is going to be updated. [ 997.690355] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.690355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.690355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.690558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.690760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.701516] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: IN_PROGRESS for 2s [ 998.025372] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 998.025611] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.025762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.025987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.026205] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.026329] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.026388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.026749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.026838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.026930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.027035] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.408946] env[70535]: INFO networking_nsxv3.common.synchronization [req-c915c5f1-fe42-43ea-a53c-22ec8cbd3e94 req-04d9cd70-d4b2-4096-adae-076c7d5c7d24 tempest-MultipleCreateTestJSON-1547146489 tempest-MultipleCreateTestJSON-1547146489-project-member] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 998.409511] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 998.409818] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.409957] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.411108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.411360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.411529] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.411769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.411854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.412237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.412237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.412396] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.531022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.531022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.531022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.531022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.531022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.531022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.531462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.531462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.531532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.531626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.531787] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.531880] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.531946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.532136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.532278] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.532368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.532480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.532623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.532713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.532801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.533394] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.599833] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 998.600174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.600670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.600906] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.601044] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.602032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.602032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.602032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.602032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.602032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.602282] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.876353] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-489 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.876674] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.876714] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.878018] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.878018] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.878018] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.878018] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.878018] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.878223] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.878410] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.878528] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.879113] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.879113] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.879113] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.879113] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.879113] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.898208] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.898392] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 998.898537] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.898726] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.899057] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-7723a267-20e8-48ea-ba6b-64aa6013655e taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.899236] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-7723a267-20e8-48ea-ba6b-64aa6013655e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.899360] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-7723a267-20e8-48ea-ba6b-64aa6013655e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.899712] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-7723a267-20e8-48ea-ba6b-64aa6013655e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.899874] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7723a267-20e8-48ea-ba6b-64aa6013655e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.917756] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.917983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.918100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.918332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.918433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.918619] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.918720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.918830] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.919081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.919081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.919081] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be updated. [ 998.947160] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.947359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.947437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.947696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.947848] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.962744] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: IN_PROGRESS for 2s [ 999.036774] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for acf72aac-3e82-4909-b3c4-dccd81be0846: rpc.has_security_group_logging(os_id): False [ 999.058018] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.058298] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.058441] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.058629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.058710] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.058914] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.058995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.059083] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.059211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.059295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.059469] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.059556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.059614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.059752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.059826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.060019] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.060111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.060166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.060309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.060385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.060461] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 999.110054] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.110054] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.110054] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.110054] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.110054] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.110415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.110415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.110415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.110415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.110551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.111273] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.111273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.111273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.111273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.111273] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.111273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.111726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.111726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.111726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.111726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.111726] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.135554] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.135785] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.135785] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.135972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.136132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.153437] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 999.404074] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.404331] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.404491] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.404797] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.405183] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.405384] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 7723a267-20e8-48ea-ba6b-64aa6013655e not found, creating... [ 999.405697] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.405882] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.406015] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.406269] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.406421] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.406890] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.407119] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.407258] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.407514] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.407704] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.407859] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 7723a267-20e8-48ea-ba6b-64aa6013655e is going to be created. [ 999.428323] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.428563] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.428678] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.429014] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.429242] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.429473] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-7723a267-20e8-48ea-ba6b-64aa6013655e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.613845] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63056e22-45eb-4c1b-b65b-578fb5876c5b: rpc.has_security_group_logging(os_id): False [ 999.638295] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.638496] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.638496] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.638693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.638693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.638693] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.638693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.638693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.638693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.639572] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.639572] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.639853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.639853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.639853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.639938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.640389] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.640389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.640389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.640664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.642023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.642023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be created. [ 999.706612] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.706781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.706846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.707027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.707208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.714056] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: SUCCESS [ 999.714261] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.717360] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: IN_PROGRESS for 2s [ 1000.249993] env[70535]: INFO networking_nsxv3.common.synchronization [req-c915c5f1-fe42-43ea-a53c-22ec8cbd3e94 req-6f67f71c-0680-484b-82ca-0e7ac02139a6 service nova] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_rules [ 1000.250283] env[70535]: INFO networking_nsxv3.common.synchronization [req-c915c5f1-fe42-43ea-a53c-22ec8cbd3e94 req-6f67f71c-0680-484b-82ca-0e7ac02139a6 service nova] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 1000.250332] env[70535]: INFO networking_nsxv3.common.synchronization [req-c915c5f1-fe42-43ea-a53c-22ec8cbd3e94 req-6f67f71c-0680-484b-82ca-0e7ac02139a6 service nova] Enqueued Resource ID: 7723a267-20e8-48ea-ba6b-64aa6013655e with Priority: HIGHEST for action port [ 1000.250602] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_rules [ 1000.250692] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 1000.250788] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7723a267-20e8-48ea-ba6b-64aa6013655e with Priority: HIGHEST for action port [ 1000.253613] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.253613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.253613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.253613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.253613] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.254307] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.254430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.254870] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-7723a267-20e8-48ea-ba6b-64aa6013655e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.254994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7723a267-20e8-48ea-ba6b-64aa6013655e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.255071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7723a267-20e8-48ea-ba6b-64aa6013655e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.255271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7723a267-20e8-48ea-ba6b-64aa6013655e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.255350] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7723a267-20e8-48ea-ba6b-64aa6013655e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.475245] env[70535]: INFO networking_nsxv3.common.synchronization [None req-7cbd42e5-c27f-41d2-8e67-c63367c8f662 tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1000.476168] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1000.476389] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.476556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.476847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.477054] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.477218] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.477323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.477386] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.478174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.478278] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.478378] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.693848] env[70535]: INFO networking_nsxv3.common.synchronization [req-a2fce308-ee65-4796-8858-8fb86fe1b965 req-c5b7611a-3b0d-4d9c-a5f4-7bc033dfad73 tempest-ServerActionsTestOtherB-1362861695 tempest-ServerActionsTestOtherB-1362861695-project-member] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1000.694414] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1000.694975] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.694975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.694975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.695221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.695221] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.695416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.695416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.695604] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.695604] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.695688] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.757197] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.757392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.757551] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7723a267-20e8-48ea-ba6b-64aa6013655e with status ACTIVE [ 1000.757725] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.757836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.757900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.758273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.758273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.758382] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.758509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.758558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.758705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.758779] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.758948] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.759054] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.759117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.759256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.759329] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.759415] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7723a267-20e8-48ea-ba6b-64aa6013655e is going to be updated. [ 1000.783807] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.784547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.784547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.784547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.784547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.786083] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7723a267-20e8-48ea-ba6b-64aa6013655e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.975430] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 1000.975609] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 deletion is rescheduled due to dependency. [ 1000.975816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.975879] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.976110] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.976296] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.976407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.976551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.976677] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.976934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.976934] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.980159] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.093904] env[70535]: INFO networking_nsxv3.common.synchronization [req-c915c5f1-fe42-43ea-a53c-22ec8cbd3e94 req-7d20e692-3866-43d7-afb4-5ed4ddc0eb73 tempest-MultipleCreateTestJSON-1547146489 tempest-MultipleCreateTestJSON-1547146489-project-member] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 1001.093904] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 1001.093904] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.093904] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.171460] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 1001.171460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.199784] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.202154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.202154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.202154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.202154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.202154] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.202154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.202154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.202154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.202154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.202154] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be updated. [ 1001.231690] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.232894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.233105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.233450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.233745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.244521] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: IN_PROGRESS for 2s [ 1001.480414] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.481468] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.638620] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-489 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.638830] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.638999] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.639317] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.639583] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.639747] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.639865] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.640101] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.640251] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.640467] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1001.640615] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1001.640734] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1001.640845] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1001.640956] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1001.641117] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1001.641210] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1001.663032] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1001.663032] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1001.663032] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1001.663032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-489" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.663032] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-7247a66f-6759-4634-baeb-6335642859d0 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.663032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-7247a66f-6759-4634-baeb-6335642859d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.663032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-7247a66f-6759-4634-baeb-6335642859d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.663032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-7247a66f-6759-4634-baeb-6335642859d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.663032] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7247a66f-6759-4634-baeb-6335642859d0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.730195] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 1001.730611] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.986155] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.988150] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.988150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.988150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.988376] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.988376] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.988376] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be updated. [ 1002.033320] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.033320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.033320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.033320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.033320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.044892] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: IN_PROGRESS for 2s [ 1002.169450] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.169450] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.169450] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.169708] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.169708] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.169850] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 7247a66f-6759-4634-baeb-6335642859d0 not found, creating... [ 1002.170541] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.170541] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.170905] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.170905] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.171190] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.171419] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.171589] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.171725] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.171971] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.172153] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.172326] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 7247a66f-6759-4634-baeb-6335642859d0 is going to be created. [ 1002.214561] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.214883] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.215137] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.215571] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.215947] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.216353] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-7247a66f-6759-4634-baeb-6335642859d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.492959] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.492959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.492959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.492959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.492959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.492959] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be updated. [ 1002.530166] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.530166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.530166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.530166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.530166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.538244] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: IN_PROGRESS for 2s [ 1002.847751] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.851093] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.851093] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.851093] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.851093] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.851093] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.851093] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.851093] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.851093] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.851093] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.851093] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.851521] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.851521] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.851647] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.852050] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.852050] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.876051] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.876297] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1002.876628] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.877091] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.878841] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-4d663cfc-d4b6-4a79-a2bc-db39e4a244c2 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.878841] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-4d663cfc-d4b6-4a79-a2bc-db39e4a244c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.878841] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-4d663cfc-d4b6-4a79-a2bc-db39e4a244c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.878841] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-4d663cfc-d4b6-4a79-a2bc-db39e4a244c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.878841] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d663cfc-d4b6-4a79-a2bc-db39e4a244c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.106681] env[70535]: INFO networking_nsxv3.common.synchronization [req-c915c5f1-fe42-43ea-a53c-22ec8cbd3e94 req-2d62735b-6fae-4350-84c7-b32b6bcf5d4c service nova] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_rules [ 1003.106681] env[70535]: INFO networking_nsxv3.common.synchronization [req-c915c5f1-fe42-43ea-a53c-22ec8cbd3e94 req-2d62735b-6fae-4350-84c7-b32b6bcf5d4c service nova] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 1003.106681] env[70535]: INFO networking_nsxv3.common.synchronization [req-c915c5f1-fe42-43ea-a53c-22ec8cbd3e94 req-2d62735b-6fae-4350-84c7-b32b6bcf5d4c service nova] Enqueued Resource ID: 7247a66f-6759-4634-baeb-6335642859d0 with Priority: HIGHEST for action port [ 1003.106681] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_rules [ 1003.106681] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 1003.106681] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7247a66f-6759-4634-baeb-6335642859d0 with Priority: HIGHEST for action port [ 1003.108022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.108354] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.108922] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.109205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.111146] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-7247a66f-6759-4634-baeb-6335642859d0 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.111146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7247a66f-6759-4634-baeb-6335642859d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.111146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7247a66f-6759-4634-baeb-6335642859d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.111146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7247a66f-6759-4634-baeb-6335642859d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.111146] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7247a66f-6759-4634-baeb-6335642859d0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.255392] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 1003.255392] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c deletion is rescheduled due to dependency. [ 1003.255392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.386669] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.386669] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.386669] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.386669] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.386669] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.386669] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 4d663cfc-d4b6-4a79-a2bc-db39e4a244c2 not found, creating... [ 1003.386669] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.386669] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.386669] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.386669] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.386669] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.388147] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.388465] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.388713] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.389147] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.391630] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.391630] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 4d663cfc-d4b6-4a79-a2bc-db39e4a244c2 is going to be created. [ 1003.416410] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.416648] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.416786] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.417082] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.417327] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.417585] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-4d663cfc-d4b6-4a79-a2bc-db39e4a244c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.614243] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7247a66f-6759-4634-baeb-6335642859d0 with status ACTIVE [ 1003.618918] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.618918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.618918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.618918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.618918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.618918] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.618918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.618918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.618918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.618918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.618918] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.618918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.618918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.618918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.618918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.618918] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7247a66f-6759-4634-baeb-6335642859d0 is going to be updated. [ 1003.643877] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.644276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.644415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.644845] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.645077] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.645354] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7247a66f-6759-4634-baeb-6335642859d0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.054241] env[70535]: INFO networking_nsxv3.common.synchronization [req-9ac0d94c-b720-465b-9cb5-58100a175981 req-8ae24643-b665-47f8-9563-d954b468b9fa tempest-ServerAddressesTestJSON-1475389249 tempest-ServerAddressesTestJSON-1475389249-project-member] Enqueued Resource ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 with Priority: HIGHEST for action security_group_members [ 1004.054776] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 with Priority: HIGHEST for action security_group_members [ 1004.054776] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.054894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.055013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.055258] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.055425] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.055535] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.055596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.055803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.055896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.055971] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e51be07-618c-4b2f-9bf9-d52bbd1658e6',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.060642] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 1004.061020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.446802] env[70535]: INFO networking_nsxv3.common.synchronization [req-f5951d0b-0a7c-439f-ae95-1f1329346bcd req-66f721d8-08cf-4d15-ae7f-73e18945ea9d service nova] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_rules [ 1004.447153] env[70535]: INFO networking_nsxv3.common.synchronization [req-f5951d0b-0a7c-439f-ae95-1f1329346bcd req-66f721d8-08cf-4d15-ae7f-73e18945ea9d service nova] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1004.447352] env[70535]: INFO networking_nsxv3.common.synchronization [req-f5951d0b-0a7c-439f-ae95-1f1329346bcd req-66f721d8-08cf-4d15-ae7f-73e18945ea9d service nova] Enqueued Resource ID: 4d663cfc-d4b6-4a79-a2bc-db39e4a244c2 with Priority: HIGHEST for action port [ 1004.447896] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_rules [ 1004.448363] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1004.448548] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d663cfc-d4b6-4a79-a2bc-db39e4a244c2 with Priority: HIGHEST for action port [ 1004.449221] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.449355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.449491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.449633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.449710] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.451079] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.451219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.451287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.451600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.451780] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.452275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.452373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.452953] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.453106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.453225] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.454039] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d663cfc-d4b6-4a79-a2bc-db39e4a244c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.454153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d663cfc-d4b6-4a79-a2bc-db39e4a244c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.454241] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d663cfc-d4b6-4a79-a2bc-db39e4a244c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.454368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d663cfc-d4b6-4a79-a2bc-db39e4a244c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.454432] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d663cfc-d4b6-4a79-a2bc-db39e4a244c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.551081] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 1004.551309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.551486] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.551839] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.552054] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.552185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.552341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.552414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.552489] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.552610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.552684] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.557901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.558146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.558340] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.558461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.558553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.558666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.558747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.558839] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.566402] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.567027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.567027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.567027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.567583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.568847] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.569019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.569098] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.569254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.569387] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.569468] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 already deleted. [ 1004.570480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.700959] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-347 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.702119] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-347" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.702119] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-347" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.702119] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-347" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.702119] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.702119] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.702119] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.702753] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.703034] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.703222] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.703357] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.703460] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.703672] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.703672] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.703818] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.703932] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.731286] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.731428] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1004.731576] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.731774] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-347" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.732106] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-59d55358-44c5-4fe3-968e-b1f548ef8ee6 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.732291] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-59d55358-44c5-4fe3-968e-b1f548ef8ee6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.732484] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-59d55358-44c5-4fe3-968e-b1f548ef8ee6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.732729] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-59d55358-44c5-4fe3-968e-b1f548ef8ee6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.733195] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59d55358-44c5-4fe3-968e-b1f548ef8ee6',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.951729] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.951873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.956379] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d663cfc-d4b6-4a79-a2bc-db39e4a244c2 with status ACTIVE [ 1004.956649] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.956792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.956863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.957095] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.957189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.957366] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.957464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.957534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.959875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.959875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.959875] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.959875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.959875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.959875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.959875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.959875] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d663cfc-d4b6-4a79-a2bc-db39e4a244c2 is going to be updated. [ 1004.959875] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.985326] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.985326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.985326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.985326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.985326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.985326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d663cfc-d4b6-4a79-a2bc-db39e4a244c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.062202] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.062202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.067014] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.236255] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.236486] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.236700] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.237038] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.237226] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.237419] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 59d55358-44c5-4fe3-968e-b1f548ef8ee6 not found, creating... [ 1005.237764] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.237944] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.238142] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.238439] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.238622] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.238982] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.239174] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.239324] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.239555] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.239727] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.239886] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 59d55358-44c5-4fe3-968e-b1f548ef8ee6 is going to be created. [ 1005.263680] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.264140] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.264317] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.264624] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.264894] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.265186] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-59d55358-44c5-4fe3-968e-b1f548ef8ee6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.466740] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.571538] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.971750] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.971750] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.971750] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.971750] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.971750] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.971750] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be updated. [ 1006.003715] env[70535]: INFO networking_nsxv3.common.synchronization [req-9ac0d94c-b720-465b-9cb5-58100a175981 req-6be51bfc-c183-4f18-8098-1e4cc01a03f9 service nova] Enqueued Resource ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 with Priority: HIGHEST for action security_group_rules [ 1006.004159] env[70535]: INFO networking_nsxv3.common.synchronization [req-9ac0d94c-b720-465b-9cb5-58100a175981 req-6be51bfc-c183-4f18-8098-1e4cc01a03f9 service nova] Enqueued Resource ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 with Priority: HIGHEST for action security_group_members [ 1006.004395] env[70535]: INFO networking_nsxv3.common.synchronization [req-9ac0d94c-b720-465b-9cb5-58100a175981 req-6be51bfc-c183-4f18-8098-1e4cc01a03f9 service nova] Enqueued Resource ID: 59d55358-44c5-4fe3-968e-b1f548ef8ee6 with Priority: HIGHEST for action port [ 1006.005715] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 with Priority: HIGHEST for action security_group_rules [ 1006.006339] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 with Priority: HIGHEST for action security_group_members [ 1006.006339] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59d55358-44c5-4fe3-968e-b1f548ef8ee6 with Priority: HIGHEST for action port [ 1006.006874] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e51be07-618c-4b2f-9bf9-d52bbd1658e6 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.007048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.007500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.007986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.008161] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e51be07-618c-4b2f-9bf9-d52bbd1658e6',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.009129] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.009245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.009313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.009549] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.009675] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.009778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.010193] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.010422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.010522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.010649] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e51be07-618c-4b2f-9bf9-d52bbd1658e6',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.011860] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-59d55358-44c5-4fe3-968e-b1f548ef8ee6 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.012060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59d55358-44c5-4fe3-968e-b1f548ef8ee6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.012154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59d55358-44c5-4fe3-968e-b1f548ef8ee6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.012748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59d55358-44c5-4fe3-968e-b1f548ef8ee6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.012748] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59d55358-44c5-4fe3-968e-b1f548ef8ee6',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.014149] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.014272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.014367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.014635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.014790] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.026941] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: IN_PROGRESS for 2s [ 1006.077433] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.078538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.078538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.078538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.078538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.078538] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be updated. [ 1006.124436] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.124436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.124436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.124436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.124726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.137156] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: IN_PROGRESS for 2s [ 1006.517226] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e51be07-618c-4b2f-9bf9-d52bbd1658e6',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.520058] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.520058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.520058] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59d55358-44c5-4fe3-968e-b1f548ef8ee6 with status ACTIVE [ 1006.525275] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.525275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.525275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.526431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.526431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.527240] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.527240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.527240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.527240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.527240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.527579] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.527743] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.527743] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.527838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.528849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.528849] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59d55358-44c5-4fe3-968e-b1f548ef8ee6 is going to be updated. [ 1006.558179] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.558366] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.558420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.558661] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.558808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.559084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59d55358-44c5-4fe3-968e-b1f548ef8ee6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.022034] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e51be07-618c-4b2f-9bf9-d52bbd1658e6',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.523749] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.525028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.525028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.525028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.525028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.525028] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 is going to be created. [ 1007.556048] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.556048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.556048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.556398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.556398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.569698] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 in Status: UNINITIALIZED for 2s [ 1008.039196] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 1008.039538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.039693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.039924] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.040222] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.040424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.040532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.040789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.040940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.044491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.044643] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.150735] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 1008.151162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.152367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.152367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.152367] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.152367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.152367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.152367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.152367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.152932] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.454387] env[70535]: INFO networking_nsxv3.common.synchronization [req-8bd4aac0-89c1-4a24-ae27-2ef47e017ed3 req-af9a7d33-d18f-4da1-b160-b65cfda7abdb tempest-ImagesOneServerNegativeTestJSON-495716502 tempest-ImagesOneServerNegativeTestJSON-495716502-project-member] Enqueued Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 1008.454986] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 1008.455393] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.455519] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.455609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.455925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.457427] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.457729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.457729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.461152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.461152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.461152] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.551168] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.551168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.551168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.551168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.551168] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.551168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.551168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.551168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.551168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.551168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.551168] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.551168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.551168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.551168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.551168] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.551168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.552180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.552180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.552180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.552180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.552180] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.655038] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.962436] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.962841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.962841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.963022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.963022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.963165] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.963277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.963342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.963476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.963555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.963642] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50631980-025e-4f7c-a21a-486351e09d1f is going to be updated. [ 1008.996305] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.996498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.996658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.996910] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.997103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.009172] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: IN_PROGRESS for 2s [ 1009.054741] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63056e22-45eb-4c1b-b65b-578fb5876c5b: rpc.has_security_group_logging(os_id): False [ 1009.075555] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.075555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.075862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.075862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.076243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.076243] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.076243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.079257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.079257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.079257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.079257] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.079257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.079257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.079257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.079257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.079257] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.079257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.079257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.079257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.079257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.079257] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be updated. [ 1009.088266] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-198 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.088568] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-198" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.088724] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-198" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.089026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-198" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.089354] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.089526] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.089688] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.089969] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.090126] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.090377] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.090500] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.090615] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.090767] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.090899] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.091026] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.091193] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.126436] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.126823] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1009.127042] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.127246] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-198" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.127655] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-2986eeef-cd0a-4849-8f53-08fe05e35e29 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.127833] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-2986eeef-cd0a-4849-8f53-08fe05e35e29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.127984] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-2986eeef-cd0a-4849-8f53-08fe05e35e29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.128358] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-2986eeef-cd0a-4849-8f53-08fe05e35e29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.128501] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2986eeef-cd0a-4849-8f53-08fe05e35e29',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.158304] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.188224] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.188391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.188476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.188778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.188942] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.207076] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: IN_PROGRESS for 2s [ 1009.282366] env[70535]: INFO networking_nsxv3.common.synchronization [req-780f0bb5-6a11-469a-9250-1626a9f884f9 req-896a16cd-1782-4861-9727-7278c439ed96 tempest-ImagesTestJSON-1564979202 tempest-ImagesTestJSON-1564979202-project-member] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 1009.283384] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 1009.284046] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.284238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.284336] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.284715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.284919] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.285064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.285152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.285371] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.285505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.285609] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.583804] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 in Status: SUCCESS [ 1009.584041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.584219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.584444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.584686] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.584838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.584893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.585080] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.586553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.586553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.586553] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e51be07-618c-4b2f-9bf9-d52bbd1658e6',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.632986] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.634786] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.634786] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.634786] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.634786] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.634786] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 2986eeef-cd0a-4849-8f53-08fe05e35e29 not found, creating... [ 1009.634786] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.634786] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.634786] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.636282] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.636282] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.636282] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.636282] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.636282] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.636282] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.639565] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.639778] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 2986eeef-cd0a-4849-8f53-08fe05e35e29 is going to be created. [ 1009.662514] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.662514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.662514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.662514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.662514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.662514] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be updated. [ 1009.687944] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.689161] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.689283] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.689649] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.690170] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.690325] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-2986eeef-cd0a-4849-8f53-08fe05e35e29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.708536] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.708778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.708778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.709948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.709948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.722503] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: IN_PROGRESS for 2s [ 1009.789403] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.789660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.790075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.790075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.790258] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.790529] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.790709] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.790813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.791672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.791672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.791672] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 1009.852393] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.852393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.852393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.852393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.852393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.864040] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 1010.090030] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.090503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.090503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.090503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.090503] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.091260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.091260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.091260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.091260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.091260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.091260] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.091260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.091260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.092359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.092359] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.092359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.092359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.092359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.092359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.092359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.092359] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e51be07-618c-4b2f-9bf9-d52bbd1658e6',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.329457] env[70535]: INFO networking_nsxv3.common.synchronization [req-8ee442fa-7ee8-47db-9bce-ec4658b4c09b req-30dbf619-3dc7-4591-a43c-8aeb2097fd47 tempest-AttachVolumeShelveTestJSON-2125264447 tempest-AttachVolumeShelveTestJSON-2125264447-project-member] Enqueued Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_members [ 1010.330243] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGHEST for action security_group_members [ 1010.330925] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c30db4ac-0243-4260-914e-2e6a0283c93a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.330925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.330925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.331227] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.331281] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.331370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.331430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.331587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.331705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.331845] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.544824] env[70535]: INFO networking_nsxv3.common.synchronization [req-8bd4aac0-89c1-4a24-ae27-2ef47e017ed3 req-56f37ab2-2031-4fa5-b8f9-cee3a6eab2bb service nova] Enqueued Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_rules [ 1010.545146] env[70535]: INFO networking_nsxv3.common.synchronization [req-8bd4aac0-89c1-4a24-ae27-2ef47e017ed3 req-56f37ab2-2031-4fa5-b8f9-cee3a6eab2bb service nova] Enqueued Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 1010.545327] env[70535]: INFO networking_nsxv3.common.synchronization [req-8bd4aac0-89c1-4a24-ae27-2ef47e017ed3 req-56f37ab2-2031-4fa5-b8f9-cee3a6eab2bb service nova] Enqueued Resource ID: 2986eeef-cd0a-4849-8f53-08fe05e35e29 with Priority: HIGHEST for action port [ 1010.546025] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_rules [ 1010.546316] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 1010.546449] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2986eeef-cd0a-4849-8f53-08fe05e35e29 with Priority: HIGHEST for action port [ 1010.546918] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.547139] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.547174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.547526] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.547653] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.548726] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.548883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.549402] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-2986eeef-cd0a-4849-8f53-08fe05e35e29 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.549571] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2986eeef-cd0a-4849-8f53-08fe05e35e29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.549688] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2986eeef-cd0a-4849-8f53-08fe05e35e29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.550035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2986eeef-cd0a-4849-8f53-08fe05e35e29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.550160] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2986eeef-cd0a-4849-8f53-08fe05e35e29',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.596176] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e51be07-618c-4b2f-9bf9-d52bbd1658e6: rpc.has_security_group_logging(os_id): False [ 1010.617933] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.618131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.618268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.618524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.618633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.618862] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.619019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.619106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.619514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.619514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.619674] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.619674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.619908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.619908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.620184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.620251] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.620336] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.620739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.620739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.620739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.620739] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 is going to be created. [ 1010.695326] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.696047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.696047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.696047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.696047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.710992] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 in Status: IN_PROGRESS for 2s [ 1010.834853] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.835030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.835109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.835319] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.835431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.835637] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.835741] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.835871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.835956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.836049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.836140] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c30db4ac-0243-4260-914e-2e6a0283c93a is going to be updated. [ 1010.885965] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.886203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.886281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.886529] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.887280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.898161] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c30db4ac-0243-4260-914e-2e6a0283c93a in Status: IN_PROGRESS for 2s [ 1011.020326] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: SUCCESS [ 1011.020565] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50631980-025e-4f7c-a21a-486351e09d1f deletion is rescheduled due to dependency. [ 1011.020744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.020982] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.021270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.021612] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.021753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.021796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.021952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.022126] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.022255] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.053232] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.053232] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.053232] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2986eeef-cd0a-4849-8f53-08fe05e35e29 with status ACTIVE [ 1011.053232] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.053232] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.053232] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.053530] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.053582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.053869] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.054018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.054331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.054388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.054597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.054899] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.055064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.055145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.055375] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.055495] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.055566] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2986eeef-cd0a-4849-8f53-08fe05e35e29 is going to be updated. [ 1011.086044] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.086317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.086317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.086809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.086892] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.087043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2986eeef-cd0a-4849-8f53-08fe05e35e29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.246308] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 1011.246308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.527658] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.737515] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 1011.737797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.738032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.738224] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.738418] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.738628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.738628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.738769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.738859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.738926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.739055] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.739149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.739235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.739379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.739532] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.739630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.739687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.742809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.742809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.742809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.742809] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.875220] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 1011.875220] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e deletion is rescheduled due to dependency. [ 1011.875350] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.030354] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.245143] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec7c706b-a1b7-4402-b5c2-6e8302636c80: rpc.has_security_group_logging(os_id): False [ 1012.270673] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.271064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.271064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.271174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.271226] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.271535] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.271535] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.271652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.271797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.271879] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.272110] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.272202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.272282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.272425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.272500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.272681] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.272777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.272841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.272985] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.273245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.273971] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be updated. [ 1012.343700] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.343936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.344025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.344328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.344522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.362919] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: IN_PROGRESS for 2s [ 1012.536324] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.536324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.536324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.536324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.536324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.536324] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50631980-025e-4f7c-a21a-486351e09d1f is going to be updated. [ 1012.572337] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.572489] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.572586] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.572828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.572979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.583337] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: IN_PROGRESS for 2s [ 1012.726138] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 in Status: SUCCESS [ 1012.726394] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.908496] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c30db4ac-0243-4260-914e-2e6a0283c93a in Status: SUCCESS [ 1012.908715] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c30db4ac-0243-4260-914e-2e6a0283c93a deletion is rescheduled due to dependency. [ 1012.908839] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.377960] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 1014.378318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.378505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.378785] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.378914] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.594364] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: SUCCESS [ 1014.594832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.594832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.594951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.595215] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.595362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.595362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.595480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.595589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.595633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.595795] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.882830] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.883039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.883125] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.883387] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.883571] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.883787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.883787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.883925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.884127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.884172] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.884250] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.100743] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.101017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.101017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.101323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.101553] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.101687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.101777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.101975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.102113] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.102228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.102393] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.102504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.102579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.102731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.102892] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.103018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.103090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.103256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.103341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.103429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.103523] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.389680] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.389977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.390026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.390364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.390578] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.390734] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.390810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.391482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.391482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.391482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.391482] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.391747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.391747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.391747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.391986] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.392107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.392172] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.392320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.392402] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.392487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.392579] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.548129] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1015.548437] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1015.605833] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50631980-025e-4f7c-a21a-486351e09d1f: rpc.has_security_group_logging(os_id): False [ 1015.627247] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.627445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.627445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.627675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.628087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.628087] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.628087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.628282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.628282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.628355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.628551] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.628665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.628718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.628834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.628906] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.629213] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.629213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.629371] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.629406] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.629584] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.629584] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50631980-025e-4f7c-a21a-486351e09d1f is going to be updated. [ 1015.697121] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.697315] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.697399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.697674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.697867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.715925] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: IN_PROGRESS for 2s [ 1015.898133] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec7c706b-a1b7-4402-b5c2-6e8302636c80: rpc.has_security_group_logging(os_id): False [ 1015.913185] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.913340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.913431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.913647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.913778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.913980] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.914115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.914205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.914401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.914505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.914805] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.914924] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.915021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.915925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.916080] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.916313] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.916552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.916552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.918438] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.918438] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.918438] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be updated. [ 1015.983847] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.984059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.984164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.984420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.984593] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.000240] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: IN_PROGRESS for 2s [ 1016.787667] env[70535]: INFO networking_nsxv3.common.synchronization [req-9aba8542-9ee6-4b23-9cf1-78619cfbfb8c req-658aaf1b-74c5-4239-a94e-fe084bff2194 tempest-MultipleCreateTestJSON-1547146489 tempest-MultipleCreateTestJSON-1547146489-project-member] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 1016.788250] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 1016.788561] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.788786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.788786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.788950] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.789248] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.789403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.789574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.789705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.789835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.789967] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.142533] env[70535]: INFO networking_nsxv3.common.synchronization [req-e663cbaa-63f7-4973-8dbf-b1a0f2d17353 req-f075298f-4673-4477-abe0-eb5678e43877 tempest-VolumesAdminNegativeTest-1297223157 tempest-VolumesAdminNegativeTest-1297223157-project-member] Enqueued Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGHEST for action security_group_members [ 1017.143118] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGHEST for action security_group_members [ 1017.143468] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-b05014f4-0d5c-444e-a37c-dbe58f585d75 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.143672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.143672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.143865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.144021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.144115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.144172] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.144316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.144434] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.144551] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b05014f4-0d5c-444e-a37c-dbe58f585d75',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.292946] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.650084] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.650084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.650084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.650084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.650084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.650084] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.650084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.650084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.650084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.650084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.650084] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 is going to be updated. [ 1017.687988] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.687988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.687988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.687988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.688353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.700874] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 in Status: IN_PROGRESS for 2s [ 1017.731656] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: SUCCESS [ 1017.731656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.797588] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.021321] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 1018.021405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.106678] env[70535]: INFO networking_nsxv3.common.synchronization [req-36af0705-73ec-4b16-8f6b-6ef7674dd25b req-1c94d57e-07f4-4701-ad20-983c3a71728f tempest-ServersAdminTestJSON-1221450413 tempest-ServersAdminTestJSON-1221450413-project-member] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 1018.107505] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGHEST for action security_group_members [ 1018.107944] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.108167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.108274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.108807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.109073] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.109509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.109509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.109509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.109876] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.109876] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.271355] env[70535]: INFO networking_nsxv3.common.synchronization [req-b29fe060-81ee-4ef4-988c-0f6e204619c9 req-eac748f7-ba62-4037-bb49-ef084957df1b tempest-MultipleCreateTestJSON-1547146489 tempest-MultipleCreateTestJSON-1547146489-project-member] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 1018.271906] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGHEST for action security_group_members [ 1018.273708] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.273708] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.298857] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.299049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.299118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.299375] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.299490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.299586] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be updated. [ 1018.331489] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.331661] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.331748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.331976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.332156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.345699] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: IN_PROGRESS for 2s [ 1018.601852] env[70535]: INFO networking_nsxv3.common.synchronization [req-bb8f8d38-e6c5-476a-92f5-d70048944cc8 req-21d7903a-3e57-4f84-8bfa-a338e7050dd3 tempest-ServerAddressesTestJSON-1475389249 tempest-ServerAddressesTestJSON-1475389249-project-member] Enqueued Resource ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 with Priority: HIGHEST for action security_group_members [ 1018.602661] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 with Priority: HIGHEST for action security_group_members [ 1018.603338] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.603338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.603548] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.604213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.604442] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.604521] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.604658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.604898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.604988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.605116] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e51be07-618c-4b2f-9bf9-d52bbd1658e6',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.612446] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.612657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.612657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.612860] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.613010] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.613500] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.613500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.613500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.613500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.613500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.613714] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be updated. [ 1018.646915] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.646915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.647117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.647551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.647551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.661300] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: IN_PROGRESS for 2s [ 1018.698045] env[70535]: INFO networking_nsxv3.common.synchronization [req-710042c0-991d-4748-a06b-c497c1041f70 req-fffc2637-2473-450d-83e6-ac92b68ab441 tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1018.699067] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1018.702952] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.702952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.702952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.702952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.702952] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.702952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.702952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.702952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.702952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.702952] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.108811] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.109130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.109130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.109255] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.109340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.109587] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.109659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.109659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.110233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.110331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.110428] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 is going to be updated. [ 1019.138149] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.138322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.138382] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.138602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.138746] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.150156] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 in Status: IN_PROGRESS for 2s [ 1019.205821] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.610147] env[70535]: INFO networking_nsxv3.common.synchronization [None req-a72a5076-8cc1-4eb6-bee3-a1f59a20fa87 tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1019.610147] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1019.610537] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.610684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.708938] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.711910] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 in Status: SUCCESS [ 1019.712502] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 deletion is rescheduled due to dependency. [ 1019.712502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.213231] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.213231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.213231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.213231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.213231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.213231] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be updated. [ 1020.259675] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.259675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.259675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.259675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.259675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.271866] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: IN_PROGRESS for 2s [ 1020.356303] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 1020.356672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.356672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.357816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.357816] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.357816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.357816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.357816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.357816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.357816] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.381992] env[70535]: INFO networking_nsxv3.common.synchronization [req-49f1ba01-a8c0-4faa-a8f7-d2e75bca87bc req-8c08ffa8-488a-4eb1-a656-7cd23dc6d4d7 tempest-ImagesOneServerTestJSON-2067594152 tempest-ImagesOneServerTestJSON-2067594152-project-member] Enqueued Resource ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 with Priority: HIGHEST for action security_group_members [ 1020.382500] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 with Priority: HIGHEST for action security_group_members [ 1020.382982] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.382982] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.383277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.383277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.383406] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.383506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.384245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.384245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.384245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.384245] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ebf2f9b-61f1-41ce-8d01-84394f8e9115',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.668359] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c in Status: SUCCESS [ 1020.668715] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c deletion is rescheduled due to dependency. [ 1020.669056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.860674] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.860841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.860914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.861171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.861265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.861465] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.861572] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.862563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.862773] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.862921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.863045] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be updated. [ 1020.887189] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.887270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.887303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.887609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.887609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.887816] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.887965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.888023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.888169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.888248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.888337] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 is going to be updated. [ 1020.911280] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.911435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.911507] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.911765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.911916] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.940031] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: IN_PROGRESS for 2s [ 1020.946705] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.946964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.946964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.947192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.947310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.956355] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 in Status: IN_PROGRESS for 2s [ 1021.172169] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 in Status: SUCCESS [ 1021.172361] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 deletion is rescheduled due to dependency. [ 1021.172478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.861014] env[70535]: INFO networking_nsxv3.common.synchronization [req-48630daa-d87b-4129-8c98-ee795cb747ac req-dd047089-5309-406a-940f-88609d7f76e5 tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 with Priority: HIGHEST for action security_group_members [ 1021.861604] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 with Priority: HIGHEST for action security_group_members [ 1021.861905] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc5fb1bb-573b-4a41-9b95-86e55eedb265 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.862046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.862112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.862315] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.862944] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.862944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.862944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.862944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.862944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.862944] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc5fb1bb-573b-4a41-9b95-86e55eedb265',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.282254] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 1022.282530] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.282721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.282996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.283217] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.283365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.283438] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.283615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.283699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.283803] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.367694] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.367923] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.368106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.368392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.368533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.368794] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.368930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.369017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.370042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.370042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.370042] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 is going to be updated. [ 1022.398417] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.398697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.398778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.399134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.399423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.408763] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 in Status: IN_PROGRESS for 2s [ 1022.786625] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.786832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.786926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.787177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.787273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.787473] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.787573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.787636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.787905] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.788070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.788176] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be updated. [ 1022.818621] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.819131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.819131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.819131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.819282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.827722] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: IN_PROGRESS for 2s [ 1022.954283] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 in Status: SUCCESS [ 1022.954722] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 deletion is rescheduled due to dependency. [ 1022.954722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.966508] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 in Status: SUCCESS [ 1022.966508] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 deletion is rescheduled due to dependency. [ 1022.966508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.978334] env[70535]: INFO networking_nsxv3.common.synchronization [req-86aa7485-8c01-4492-a9cf-d74314876bd4 req-22e8fa84-6bb9-47fb-8cde-222b9497abf3 tempest-ImagesOneServerNegativeTestJSON-495716502 tempest-ImagesOneServerNegativeTestJSON-495716502-project-member] Enqueued Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 1023.978862] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGHEST for action security_group_members [ 1023.979190] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.979316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.979384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.979586] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.980311] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.980438] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.980491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.980646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.980800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.980849] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.418810] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 in Status: SUCCESS [ 1024.418968] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 deletion is rescheduled due to dependency. [ 1024.419078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.482898] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.483064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.483110] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.483327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.483414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.483596] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.483690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.483749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.483996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.484087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.484173] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50631980-025e-4f7c-a21a-486351e09d1f is going to be updated. [ 1024.512258] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.512410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.512481] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.512686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.512829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.522327] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: IN_PROGRESS for 2s [ 1024.837932] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 1024.838159] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b deletion is rescheduled due to dependency. [ 1024.838263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.533488] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50631980-025e-4f7c-a21a-486351e09d1f in Status: SUCCESS [ 1026.537106] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50631980-025e-4f7c-a21a-486351e09d1f deletion is rescheduled due to dependency. [ 1026.537106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.971044] env[70535]: INFO networking_nsxv3.common.synchronization [req-e582e862-0417-41dc-87ca-3b39cc2ae514 req-9c3c6ed9-e82b-449e-8567-6a89586283e6 tempest-DeleteServersTestJSON-660883378 tempest-DeleteServersTestJSON-660883378-project-member] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1028.971044] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1028.971044] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.971044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.971044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.971044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.971044] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.971600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.971600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.971600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.971600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.971730] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.381695] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.381909] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.382091] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.382401] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.382674] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.382839] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.382959] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.383199] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.383374] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.383573] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.383694] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.383799] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.383911] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.384037] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.384152] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.384289] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.417876] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.418214] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1029.418410] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.418619] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.418957] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-1b502e1b-cb96-4c68-9a9a-76b65c50b515 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.419387] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-1b502e1b-cb96-4c68-9a9a-76b65c50b515" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.419464] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-1b502e1b-cb96-4c68-9a9a-76b65c50b515" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.419815] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-1b502e1b-cb96-4c68-9a9a-76b65c50b515" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.419995] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b502e1b-cb96-4c68-9a9a-76b65c50b515',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.474137] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.474306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.474379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.474608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.474709] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.474895] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.474994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.475070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.475223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.475310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.475399] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1029.505673] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.505913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.505913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.506122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.506263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.514923] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1029.923069] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.923302] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.923416] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.923721] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.923885] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.924063] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 1b502e1b-cb96-4c68-9a9a-76b65c50b515 not found, creating... [ 1029.924368] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.924646] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.924868] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.925071] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.925565] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.926089] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.926399] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.926921] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.927220] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.927471] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.927652] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 1b502e1b-cb96-4c68-9a9a-76b65c50b515 is going to be created. [ 1029.953227] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.953450] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.953578] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.953862] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.954282] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.954579] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-1b502e1b-cb96-4c68-9a9a-76b65c50b515" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.785079] env[70535]: INFO networking_nsxv3.common.synchronization [req-e582e862-0417-41dc-87ca-3b39cc2ae514 req-67d01f16-92f0-418e-af78-7091ac7f0026 service nova] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_rules [ 1030.785359] env[70535]: INFO networking_nsxv3.common.synchronization [req-e582e862-0417-41dc-87ca-3b39cc2ae514 req-67d01f16-92f0-418e-af78-7091ac7f0026 service nova] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1030.785448] env[70535]: INFO networking_nsxv3.common.synchronization [req-e582e862-0417-41dc-87ca-3b39cc2ae514 req-67d01f16-92f0-418e-af78-7091ac7f0026 service nova] Enqueued Resource ID: 1b502e1b-cb96-4c68-9a9a-76b65c50b515 with Priority: HIGHEST for action port [ 1030.786145] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_rules [ 1030.786390] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1030.786431] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b502e1b-cb96-4c68-9a9a-76b65c50b515 with Priority: HIGHEST for action port [ 1030.786778] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.786863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.787059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.787730] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.787820] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.790059] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.790210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.790453] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b502e1b-cb96-4c68-9a9a-76b65c50b515 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.790567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b502e1b-cb96-4c68-9a9a-76b65c50b515" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.790633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b502e1b-cb96-4c68-9a9a-76b65c50b515" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.790821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b502e1b-cb96-4c68-9a9a-76b65c50b515" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.790920] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b502e1b-cb96-4c68-9a9a-76b65c50b515',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.825214] env[70535]: INFO networking_nsxv3.common.synchronization [req-bd2c2487-4f56-48a2-8ed7-b24386bdcbad req-e005aaca-2cfb-4199-a684-918fd20eb9bd tempest-ServerActionsTestJSON-1674828100 tempest-ServerActionsTestJSON-1674828100-project-member] Enqueued Resource ID: 4671052a-29bf-476d-9785-63d1baee1810 with Priority: HIGHEST for action security_group_members [ 1030.825717] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4671052a-29bf-476d-9785-63d1baee1810 with Priority: HIGHEST for action security_group_members [ 1030.826199] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-4671052a-29bf-476d-9785-63d1baee1810 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.826302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.826302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.826853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.826853] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.826853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.826853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.827084] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.827121] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.827290] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4671052a-29bf-476d-9785-63d1baee1810',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.290709] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.290883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.295304] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b502e1b-cb96-4c68-9a9a-76b65c50b515 with status ACTIVE [ 1031.295527] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.295666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.295818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.295955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.296126] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.296256] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.296363] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.296414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.296562] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.296639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.296820] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.296981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.296981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.298445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.298445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.298445] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b502e1b-cb96-4c68-9a9a-76b65c50b515 is going to be updated. [ 1031.326102] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.326102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.326102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.326102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.326446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.326446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b502e1b-cb96-4c68-9a9a-76b65c50b515" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.332490] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.332490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.332490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.332490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.332490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.332490] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.332490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.332490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.332490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.332490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.332490] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4671052a-29bf-476d-9785-63d1baee1810 is going to be updated. [ 1031.365035] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.365206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.365285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.365511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.365723] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.376435] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4671052a-29bf-476d-9785-63d1baee1810 in Status: IN_PROGRESS for 2s [ 1031.528163] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1031.528163] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f deletion is rescheduled due to dependency. [ 1031.528163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.528163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.528163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.528163] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.528163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.528163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.528163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.528163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.528163] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.034456] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.537178] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.039746] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.040099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.040099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.040257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.040340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.040400] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1033.068815] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.069140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.069226] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.069469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.069622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.079490] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1033.386358] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4671052a-29bf-476d-9785-63d1baee1810 in Status: SUCCESS [ 1033.386593] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4671052a-29bf-476d-9785-63d1baee1810 deletion is rescheduled due to dependency. [ 1033.386734] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.089768] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1035.090180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.090246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.090521] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.090720] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.090834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.090901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.091064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.091147] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.091242] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.091335] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.340699] env[70535]: INFO networking_nsxv3.common.synchronization [req-c5b0bc51-1ece-4c11-b21c-8e5c29d191ec req-5a73ae20-9edc-423c-a88f-3f33175b0557 tempest-ServersTestManualDisk-419272698 tempest-ServersTestManualDisk-419272698-project-member] Enqueued Resource ID: f932dfa4-49e7-4477-968f-48bf223104fa with Priority: HIGHEST for action security_group_members [ 1035.341403] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f932dfa4-49e7-4477-968f-48bf223104fa with Priority: HIGHEST for action security_group_members [ 1035.341751] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f932dfa4-49e7-4477-968f-48bf223104fa taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.341894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.341966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.343951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.344140] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.344256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.344325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.344494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.344587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.344686] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f932dfa4-49e7-4477-968f-48bf223104fa',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.598338] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.598338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.598338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.598338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.598338] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.598338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.598338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.598338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.598338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.598338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.598338] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.598338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.598338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.598338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.598338] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.598338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.599938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.599938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.599938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.599938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.599938] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.836777] env[70535]: INFO networking_nsxv3.common.synchronization [req-972f1099-3b4e-4f12-a8dc-89caf2d34b80 req-997c0052-4a41-4e6b-a609-43b1b4523680 tempest-ImagesTestJSON-1564979202 tempest-ImagesTestJSON-1564979202-project-member] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 1035.837342] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 1035.838262] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.838262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.838262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.838262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.838262] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.838542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.838542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.838542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.838637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.839386] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.847473] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.847663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.847744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.848400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.848400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.848528] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.850742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.850742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.850742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.850742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.850742] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f932dfa4-49e7-4477-968f-48bf223104fa is going to be updated. [ 1035.901873] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.901873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.901873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.903221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.903421] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.914063] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f932dfa4-49e7-4477-968f-48bf223104fa in Status: IN_PROGRESS for 2s [ 1036.103201] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9eeea75-d1ec-4e08-9721-eccdc9dae25f: rpc.has_security_group_logging(os_id): False [ 1036.120867] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.121337] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.121492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.121747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.121842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.122052] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.122165] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.122228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.122375] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.122451] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.124804] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.124804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.124804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.124804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.124804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.124804] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.124804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.124804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.124804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.124804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.124804] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1036.186263] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.186411] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.186462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.186668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.187030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.213809] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1036.291520] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.291731] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.291854] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.292169] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.292533] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.292627] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.292729] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.292969] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.293147] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.293377] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1036.293492] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1036.293609] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1036.293727] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1036.293843] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1036.293956] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1036.294121] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1036.319595] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1036.319595] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1036.319595] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1036.319595] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-604" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.319931] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-7d92b87c-95eb-4822-a94e-ac318663e9a9 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.320149] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-7d92b87c-95eb-4822-a94e-ac318663e9a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.320285] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-7d92b87c-95eb-4822-a94e-ac318663e9a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.320642] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-7d92b87c-95eb-4822-a94e-ac318663e9a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.320808] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d92b87c-95eb-4822-a94e-ac318663e9a9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.343289] env[70535]: INFO networking_nsxv3.common.synchronization [req-4f0e5aec-f8a2-4b63-968a-3cd92b552f5e req-243024bf-9c8d-4afe-b3bc-7af2d40116e2 tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae with Priority: HIGHEST for action security_group_members [ 1036.343811] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.344190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.344190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.344325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.344325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.345356] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.345356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.345356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.345356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.345356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.345356] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 1036.349021] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae with Priority: HIGHEST for action security_group_members [ 1036.350911] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ac4f9b-8f0d-49c2-916e-fc155db340ae taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.351089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.351174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.351356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.351524] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.351626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.351673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.351823] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.351898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.351987] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ac4f9b-8f0d-49c2-916e-fc155db340ae',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.380945] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.380945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.380945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.380945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.380945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.392894] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 1036.829026] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.829026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.829026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.829026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.829026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.829026] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 7d92b87c-95eb-4822-a94e-ac318663e9a9 not found, creating... [ 1036.829026] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.829026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.829026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.829026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.829026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.829585] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.829585] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.829585] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.829585] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.829585] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.831773] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 7d92b87c-95eb-4822-a94e-ac318663e9a9 is going to be created. [ 1036.859806] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.859806] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.859806] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.859806] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.859806] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.859806] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-7d92b87c-95eb-4822-a94e-ac318663e9a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.859806] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.859806] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.859806] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.859806] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.859806] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.860451] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.860451] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.860451] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.860451] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.860451] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.860451] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae is going to be updated. [ 1036.891480] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.891635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.891692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.891899] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.892053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.910016] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae in Status: IN_PROGRESS for 2s [ 1037.606329] env[70535]: INFO networking_nsxv3.common.synchronization [req-972f1099-3b4e-4f12-a8dc-89caf2d34b80 req-36e08795-ba3f-4096-9d1a-59e8a4d14028 service nova] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_rules [ 1037.606607] env[70535]: INFO networking_nsxv3.common.synchronization [req-972f1099-3b4e-4f12-a8dc-89caf2d34b80 req-36e08795-ba3f-4096-9d1a-59e8a4d14028 service nova] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 1037.606645] env[70535]: INFO networking_nsxv3.common.synchronization [req-972f1099-3b4e-4f12-a8dc-89caf2d34b80 req-36e08795-ba3f-4096-9d1a-59e8a4d14028 service nova] Enqueued Resource ID: 7d92b87c-95eb-4822-a94e-ac318663e9a9 with Priority: HIGHEST for action port [ 1037.606861] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_rules [ 1037.607057] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 1037.607181] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d92b87c-95eb-4822-a94e-ac318663e9a9 with Priority: HIGHEST for action port [ 1037.607773] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.607918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.607983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.608225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.608308] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.609237] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.609334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.609738] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d92b87c-95eb-4822-a94e-ac318663e9a9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.609738] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d92b87c-95eb-4822-a94e-ac318663e9a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.609738] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d92b87c-95eb-4822-a94e-ac318663e9a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.609931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d92b87c-95eb-4822-a94e-ac318663e9a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.610040] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d92b87c-95eb-4822-a94e-ac318663e9a9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.924790] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f932dfa4-49e7-4477-968f-48bf223104fa in Status: SUCCESS [ 1037.925036] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f932dfa4-49e7-4477-968f-48bf223104fa deletion is rescheduled due to dependency. [ 1037.925173] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.112940] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.113131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.114341] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d92b87c-95eb-4822-a94e-ac318663e9a9 with status ACTIVE [ 1038.114568] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.114686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.114757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.114996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.115118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.115301] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.115403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.115467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.115627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.115765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.115889] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.115984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.116058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.116199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.116275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.116405] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d92b87c-95eb-4822-a94e-ac318663e9a9 is going to be updated. [ 1038.139253] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.139448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.139503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.139824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.139927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.140113] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d92b87c-95eb-4822-a94e-ac318663e9a9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.230986] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1038.231330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.402757] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 1038.402935] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e deletion is rescheduled due to dependency. [ 1038.403096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.403291] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.403517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.403706] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.403840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.403885] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.404051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.404138] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.404230] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.907428] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.919498] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae in Status: SUCCESS [ 1038.919787] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae deletion is rescheduled due to dependency. [ 1038.919857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.409932] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.912804] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.913163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.913163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.913409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.913409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.913485] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 1039.944296] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.944502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.944580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.944772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.944967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.953673] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 1040.815812] env[70535]: INFO networking_nsxv3.common.synchronization [None req-e409e355-bcdb-4299-8cd1-451974ac8c59 tempest-AttachVolumeShelveTestJSON-2125264447 tempest-AttachVolumeShelveTestJSON-2125264447-project-member] Enqueued Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_rules [ 1040.816446] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_rules [ 1040.816830] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76787551-efbb-4eb5-bef3-77685e9cde96 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.816959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.817075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.817387] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.817465] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.891088] env[70535]: INFO networking_nsxv3.common.synchronization [None req-13d59487-671f-4c8d-9ab4-e364847a6143 tempest-AttachVolumeShelveTestJSON-2125264447 tempest-AttachVolumeShelveTestJSON-2125264447-project-member] Enqueued Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_rules [ 1040.891616] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_rules [ 1040.891959] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76787551-efbb-4eb5-bef3-77685e9cde96 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.892086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.344273] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.344725] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.344725] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.344725] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.345217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.345217] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76787551-efbb-4eb5-bef3-77685e9cde96 already deleted. [ 1041.345217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.345217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.345442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.345442] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.875512] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.875673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.875744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.875963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.876074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.876174] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76787551-efbb-4eb5-bef3-77685e9cde96 already deleted. [ 1041.876259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.966354] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 1041.966566] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.966735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.967329] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.967329] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.967540] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.967540] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.967606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.967720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.967777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.967836] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.470155] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.470446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.470446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.470599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.470770] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.470903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.470961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.472210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.472210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.472210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.472210] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.472210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.472210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.472210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.472210] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.472210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.472210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.472210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.472210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.472767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.472767] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.610167] env[70535]: INFO networking_nsxv3.common.synchronization [req-4b93ee39-f743-4237-b7e0-346cf0131efe req-5beae226-dd32-482a-844d-0440da20b36b tempest-MigrationsAdminTest-1671970304 tempest-MigrationsAdminTest-1671970304-project-member] Enqueued Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_members [ 1042.610628] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_members [ 1042.610628] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.610742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.610742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.611244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.611244] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.611619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.611619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.611619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.611619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.611759] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.980313] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52023f52-3978-48e2-8510-00221c047d2e: rpc.has_security_group_logging(os_id): False [ 1043.000983] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.000983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.000983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.000983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.000983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.000983] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.000983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.000983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.000983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.000983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.001459] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.001459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.001459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.001459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.001459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.001618] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.001666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.001717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.001855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.001941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.002300] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 1043.057886] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.058167] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.058306] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.058598] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.058856] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.059029] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.059170] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.059487] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.059531] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.059802] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1043.059922] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1043.059969] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1043.060056] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1043.060168] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1043.060277] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1043.060411] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1043.086309] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1043.086309] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1043.086667] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1043.086667] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.087156] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-f50782fe-87a8-4e81-8829-5db49a89d3b9 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.087372] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-f50782fe-87a8-4e81-8829-5db49a89d3b9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.087495] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-f50782fe-87a8-4e81-8829-5db49a89d3b9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.088103] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-f50782fe-87a8-4e81-8829-5db49a89d3b9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.088103] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f50782fe-87a8-4e81-8829-5db49a89d3b9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.091031] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.091849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.091849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.091849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.091849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.113856] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.114062] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.114062] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.114287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.114424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.114652] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.114754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.114809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.115318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.115480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.115577] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b already deleted. [ 1043.115662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.117171] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 1043.595041] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.595425] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.595425] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.596035] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.596035] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.596219] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port f50782fe-87a8-4e81-8829-5db49a89d3b9 not found, creating... [ 1043.596484] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.596484] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.596484] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.596484] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.597533] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.597683] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.597835] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.598040] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.598219] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.598373] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.598551] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: f50782fe-87a8-4e81-8829-5db49a89d3b9 is going to be created. [ 1043.623125] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.623125] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.623125] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.623125] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.623125] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.623125] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-f50782fe-87a8-4e81-8829-5db49a89d3b9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.107600] env[70535]: INFO networking_nsxv3.common.synchronization [req-4b93ee39-f743-4237-b7e0-346cf0131efe req-99fcbdca-566d-4c7e-8637-33b53c8c95fe service nova] Enqueued Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_rules [ 1045.107973] env[70535]: INFO networking_nsxv3.common.synchronization [req-4b93ee39-f743-4237-b7e0-346cf0131efe req-99fcbdca-566d-4c7e-8637-33b53c8c95fe service nova] Enqueued Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_members [ 1045.108075] env[70535]: INFO networking_nsxv3.common.synchronization [req-4b93ee39-f743-4237-b7e0-346cf0131efe req-99fcbdca-566d-4c7e-8637-33b53c8c95fe service nova] Enqueued Resource ID: f50782fe-87a8-4e81-8829-5db49a89d3b9 with Priority: HIGHEST for action port [ 1045.108606] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_rules [ 1045.108777] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_members [ 1045.108862] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f50782fe-87a8-4e81-8829-5db49a89d3b9 with Priority: HIGHEST for action port [ 1045.109151] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.109278] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.109411] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.109633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.109716] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.110792] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.110930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.110995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.111720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.111989] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.112140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.112252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.112385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.112473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.112570] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.113550] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-f50782fe-87a8-4e81-8829-5db49a89d3b9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.113655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f50782fe-87a8-4e81-8829-5db49a89d3b9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.113692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f50782fe-87a8-4e81-8829-5db49a89d3b9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.113827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f50782fe-87a8-4e81-8829-5db49a89d3b9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.113906] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f50782fe-87a8-4e81-8829-5db49a89d3b9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.143216] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 1045.144300] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.616462] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.616673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.616974] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f50782fe-87a8-4e81-8829-5db49a89d3b9 with status ACTIVE [ 1045.617254] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.617484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.617700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.617986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.618135] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.618570] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.618688] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.618736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.619022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.619099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.619406] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.619549] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.619592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.619810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.619936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.620080] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f50782fe-87a8-4e81-8829-5db49a89d3b9 is going to be updated. [ 1045.621510] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.651088] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.651302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.651302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.651520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.651687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.651846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f50782fe-87a8-4e81-8829-5db49a89d3b9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.125236] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.628685] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.628905] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.628982] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.629222] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.629340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.629625] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b is going to be created. [ 1046.659342] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.659708] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.659877] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.660115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.660340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.673588] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b in Status: UNINITIALIZED for 2s [ 1048.687793] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b in Status: SUCCESS [ 1048.687793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.687793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.687793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.687793] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.687793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.687793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.687793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.687793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.687793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.687793] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.195160] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.195160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.195160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.195160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.195816] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.196085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.197664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.197664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.197664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.197664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.197664] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.197664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.197664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.197664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.197664] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.197664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.197664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.197664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.197664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.197664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.201663] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.705648] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b: rpc.has_security_group_logging(os_id): False [ 1049.726669] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.726846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.727811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.728316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.728522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.728819] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.728940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.729016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.730507] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.731535] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.731846] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.732316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.732708] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.733093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.733287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.733610] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.733779] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.733889] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.734150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.734287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.734432] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b is going to be created. [ 1049.820169] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.820339] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.820425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.820685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.820872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.842940] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b in Status: IN_PROGRESS for 2s [ 1050.110230] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1050.110230] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1051.856046] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b in Status: SUCCESS [ 1051.856455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.145523] env[70535]: INFO networking_nsxv3.common.synchronization [req-b3d45fe6-dba9-4521-af6e-6d65a5986ee5 req-d8f3b46e-c908-4e16-bff5-73f9cbe9ed0c tempest-DeleteServersTestJSON-660883378 tempest-DeleteServersTestJSON-660883378-project-member] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1054.146764] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1054.146764] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.146764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.146988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.147221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.147413] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.147549] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.148135] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.149278] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.149278] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.149278] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.654332] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.654332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.654332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.654332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.654332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.654332] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.654332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.654332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.654332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.654332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.654332] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1054.685484] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.685669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.685746] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.685962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.686135] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.698969] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1056.155722] env[70535]: INFO networking_nsxv3.common.synchronization [None req-2a2f2aba-2f2a-4015-a333-0b589ca98f2c None None] Enqueued Resource ID: 4aa63167-4ac1-4ad4-bc04-3fe3cff4bf8f with Priority: HIGHEST for action port [ 1056.156365] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa63167-4ac1-4ad4-bc04-3fe3cff4bf8f with Priority: HIGHEST for action port [ 1056.157041] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-4aa63167-4ac1-4ad4-bc04-3fe3cff4bf8f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.157041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4aa63167-4ac1-4ad4-bc04-3fe3cff4bf8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.157041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4aa63167-4ac1-4ad4-bc04-3fe3cff4bf8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.157941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4aa63167-4ac1-4ad4-bc04-3fe3cff4bf8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.158268] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aa63167-4ac1-4ad4-bc04-3fe3cff4bf8f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.660938] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4aa63167-4ac1-4ad4-bc04-3fe3cff4bf8f [ 1056.661912] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.662127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.662235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.662387] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.662477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.662576] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4aa63167-4ac1-4ad4-bc04-3fe3cff4bf8f already deleted. [ 1056.662665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4aa63167-4ac1-4ad4-bc04-3fe3cff4bf8f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.710753] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1056.710947] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f deletion is rescheduled due to dependency. [ 1056.711090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.187905] env[70535]: INFO networking_nsxv3.common.synchronization [req-df199e55-09a9-456d-8a5b-f3ef66e56e03 req-dc20d24b-18cf-4f03-9d5f-e20fac38eeea tempest-ImagesTestJSON-1564979202 tempest-ImagesTestJSON-1564979202-project-member] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 1057.189108] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGHEST for action security_group_members [ 1057.189626] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.189803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.189878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.190101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.190358] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.190358] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.190471] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.190568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.191027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.191027] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.378254] env[70535]: INFO networking_nsxv3.common.synchronization [None req-b742e84b-fb27-4ebe-a4ce-8624bb2c2758 tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_rules [ 1057.378907] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_rules [ 1057.379587] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.379711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.379778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.380129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.380265] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.496423] env[70535]: INFO networking_nsxv3.common.synchronization [None req-2b8bb032-c1f8-47ca-ab1e-8f7319a5e7f6 tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_rules [ 1057.498356] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_rules [ 1057.498883] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.499207] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.693291] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.693463] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.693536] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.693934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.694045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.694253] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.694362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.694418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.694574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.694649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.694735] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be updated. [ 1057.724999] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.725177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.725336] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.725555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.725751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.735023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: IN_PROGRESS for 2s [ 1057.792336] env[70535]: INFO networking_nsxv3.common.synchronization [req-05c8fc14-5605-4118-81f8-9a0448a3bc4b req-3eb6bf3e-5191-47f6-a8be-382491033b35 tempest-SecurityGroupRulesNegativeTestJSON-2047350334 tempest-SecurityGroupRulesNegativeTestJSON-2047350334-project-member] Enqueued Resource ID: 20001a70-8bf5-4fe4-95c6-1ab8c8bac563 with Priority: HIGHEST for action security_group_rules [ 1057.792336] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20001a70-8bf5-4fe4-95c6-1ab8c8bac563 with Priority: HIGHEST for action security_group_rules [ 1057.792979] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20001a70-8bf5-4fe4-95c6-1ab8c8bac563 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.793419] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20001a70-8bf5-4fe4-95c6-1ab8c8bac563" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.793550] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20001a70-8bf5-4fe4-95c6-1ab8c8bac563" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.793879] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20001a70-8bf5-4fe4-95c6-1ab8c8bac563" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.794063] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20001a70-8bf5-4fe4-95c6-1ab8c8bac563',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.904302] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.904454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.904526] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.904752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.904846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.905071] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 already deleted. [ 1057.905071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.905322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.905389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.905456] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.908415] env[70535]: INFO networking_nsxv3.common.synchronization [None req-21edcaca-8588-4bb3-9659-493ecb80c49f None None] Enqueued Resource ID: 6b09cc4d-0d38-462d-a761-2352998877f3 with Priority: HIGHEST for action port [ 1057.909142] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b09cc4d-0d38-462d-a761-2352998877f3 with Priority: HIGHEST for action port [ 1057.909540] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b09cc4d-0d38-462d-a761-2352998877f3 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.909613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b09cc4d-0d38-462d-a761-2352998877f3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.909704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b09cc4d-0d38-462d-a761-2352998877f3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.911119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b09cc4d-0d38-462d-a761-2352998877f3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.911119] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b09cc4d-0d38-462d-a761-2352998877f3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.139334] env[70535]: INFO networking_nsxv3.common.synchronization [req-a5aa5762-d080-4f00-9352-4d9bd51d2700 req-11d69f21-835c-4f15-aaab-bc42d4ff00c0 tempest-SecurityGroupRulesNegativeTestJSON-2047350334 tempest-SecurityGroupRulesNegativeTestJSON-2047350334-project-member] Enqueued Resource ID: 20001a70-8bf5-4fe4-95c6-1ab8c8bac563 with Priority: HIGHEST for action security_group_rules [ 1058.139334] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20001a70-8bf5-4fe4-95c6-1ab8c8bac563 with Priority: HIGHEST for action security_group_rules [ 1058.139334] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20001a70-8bf5-4fe4-95c6-1ab8c8bac563 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.139334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20001a70-8bf5-4fe4-95c6-1ab8c8bac563" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.315420] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.316020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.316711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.317057] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.317283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.317491] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20001a70-8bf5-4fe4-95c6-1ab8c8bac563 already deleted. [ 1058.317675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20001a70-8bf5-4fe4-95c6-1ab8c8bac563" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.317918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20001a70-8bf5-4fe4-95c6-1ab8c8bac563" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.318195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20001a70-8bf5-4fe4-95c6-1ab8c8bac563" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.318415] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20001a70-8bf5-4fe4-95c6-1ab8c8bac563',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.412793] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b09cc4d-0d38-462d-a761-2352998877f3 [ 1058.413040] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.413176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.413245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.413463] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.413747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.413747] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b09cc4d-0d38-462d-a761-2352998877f3 already deleted. [ 1058.413839] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b09cc4d-0d38-462d-a761-2352998877f3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.430230] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.430511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.430590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.431123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.431123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.431123] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 already deleted. [ 1058.431123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.847767] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.847767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.847963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.848446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.848446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.848446] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20001a70-8bf5-4fe4-95c6-1ab8c8bac563 already deleted. [ 1058.848649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20001a70-8bf5-4fe4-95c6-1ab8c8bac563" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.670888] env[70535]: INFO networking_nsxv3.common.synchronization [None req-84f539c5-0b25-40c7-82cb-d5eda6ec7f3a None None] Enqueued Resource ID: 15b7d3a3-5869-41b9-bebb-d33d306ca6c3 with Priority: HIGHEST for action port [ 1059.671462] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15b7d3a3-5869-41b9-bebb-d33d306ca6c3 with Priority: HIGHEST for action port [ 1059.671775] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-15b7d3a3-5869-41b9-bebb-d33d306ca6c3 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.672223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15b7d3a3-5869-41b9-bebb-d33d306ca6c3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.672223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15b7d3a3-5869-41b9-bebb-d33d306ca6c3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.672331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15b7d3a3-5869-41b9-bebb-d33d306ca6c3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.672888] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15b7d3a3-5869-41b9-bebb-d33d306ca6c3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.748482] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52023f52-3978-48e2-8510-00221c047d2e in Status: SUCCESS [ 1059.748482] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52023f52-3978-48e2-8510-00221c047d2e deletion is rescheduled due to dependency. [ 1059.748482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.178024] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15b7d3a3-5869-41b9-bebb-d33d306ca6c3 [ 1060.179228] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.179228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.179228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.179228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.179228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.179228] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15b7d3a3-5869-41b9-bebb-d33d306ca6c3 already deleted. [ 1060.179228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15b7d3a3-5869-41b9-bebb-d33d306ca6c3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.802055] env[70535]: INFO networking_nsxv3.common.synchronization [None req-5d836f29-5a71-4d7f-af66-6a1fd3bca43e None None] Enqueued Resource ID: 142765eb-6407-4dcc-8dd7-f267ddd04a02 with Priority: HIGHEST for action port [ 1061.802055] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142765eb-6407-4dcc-8dd7-f267ddd04a02 with Priority: HIGHEST for action port [ 1061.802055] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-142765eb-6407-4dcc-8dd7-f267ddd04a02 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.802055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-142765eb-6407-4dcc-8dd7-f267ddd04a02" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.802055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-142765eb-6407-4dcc-8dd7-f267ddd04a02" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.802055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-142765eb-6407-4dcc-8dd7-f267ddd04a02" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.802055] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('142765eb-6407-4dcc-8dd7-f267ddd04a02',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.306040] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 142765eb-6407-4dcc-8dd7-f267ddd04a02 [ 1062.306290] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.306475] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.306584] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.306794] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.306877] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.306981] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:142765eb-6407-4dcc-8dd7-f267ddd04a02 already deleted. [ 1062.307081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-142765eb-6407-4dcc-8dd7-f267ddd04a02" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.835833] env[70535]: INFO networking_nsxv3.common.synchronization [req-dae1a36e-2a4a-4981-acd9-a583d33dfbcc req-1d7fc595-54cd-472f-b4aa-4696144df8ec tempest-ServerActionsTestOtherB-1362861695 tempest-ServerActionsTestOtherB-1362861695-project-member] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1062.836649] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1062.836760] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.836828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.836866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.839098] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.839296] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.839417] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.840100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.840100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.840100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.840100] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.341544] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.341699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.341767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.341982] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.342100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.342291] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.342385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.342443] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.342587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.342661] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.342763] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be updated. [ 1063.369209] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.369346] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.369422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.369657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.369810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.379302] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: IN_PROGRESS for 2s [ 1063.465627] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.466186] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.466186] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.466351] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.466483] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.466652] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.466773] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.467026] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.467469] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.467749] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.467931] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.468075] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.468900] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.468900] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.468900] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.468900] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.500397] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.500600] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1063.500744] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.500971] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.501305] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-511022f6-ead8-4463-80be-4bd5d2609c2a taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.501495] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-511022f6-ead8-4463-80be-4bd5d2609c2a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.501623] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-511022f6-ead8-4463-80be-4bd5d2609c2a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.501987] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-511022f6-ead8-4463-80be-4bd5d2609c2a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.502156] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('511022f6-ead8-4463-80be-4bd5d2609c2a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.008709] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.009193] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.009193] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.009369] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.009521] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.009685] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 511022f6-ead8-4463-80be-4bd5d2609c2a not found, creating... [ 1064.009954] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.010111] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.010234] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.010479] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.010621] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.010905] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.011076] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.011308] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.011542] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.011683] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.011827] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 511022f6-ead8-4463-80be-4bd5d2609c2a is going to be created. [ 1064.032180] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.032399] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.032529] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.032801] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.033040] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.033270] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-511022f6-ead8-4463-80be-4bd5d2609c2a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.014715] env[70535]: INFO networking_nsxv3.common.synchronization [None req-4d1f8b5e-a527-4255-867b-9d23a53835e0 None None] Enqueued Resource ID: 38c2192a-d559-41a4-a489-c7aadce57b22 with Priority: HIGHEST for action port [ 1065.016900] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38c2192a-d559-41a4-a489-c7aadce57b22 with Priority: HIGHEST for action port [ 1065.016900] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-38c2192a-d559-41a4-a489-c7aadce57b22 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.016900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38c2192a-d559-41a4-a489-c7aadce57b22" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.016900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38c2192a-d559-41a4-a489-c7aadce57b22" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.016900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38c2192a-d559-41a4-a489-c7aadce57b22" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.016900] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38c2192a-d559-41a4-a489-c7aadce57b22',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.075022] env[70535]: INFO networking_nsxv3.common.synchronization [req-dae1a36e-2a4a-4981-acd9-a583d33dfbcc req-8f106a79-0f39-4da2-bdac-d2b44243da9c service nova] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_rules [ 1065.075022] env[70535]: INFO networking_nsxv3.common.synchronization [req-dae1a36e-2a4a-4981-acd9-a583d33dfbcc req-8f106a79-0f39-4da2-bdac-d2b44243da9c service nova] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1065.075022] env[70535]: INFO networking_nsxv3.common.synchronization [req-dae1a36e-2a4a-4981-acd9-a583d33dfbcc req-8f106a79-0f39-4da2-bdac-d2b44243da9c service nova] Enqueued Resource ID: 511022f6-ead8-4463-80be-4bd5d2609c2a with Priority: HIGHEST for action port [ 1065.075022] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_rules [ 1065.075022] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1065.075022] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511022f6-ead8-4463-80be-4bd5d2609c2a with Priority: HIGHEST for action port [ 1065.075022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.075698] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.076265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.076581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.076894] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.079726] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.079726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.079726] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-511022f6-ead8-4463-80be-4bd5d2609c2a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.079726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-511022f6-ead8-4463-80be-4bd5d2609c2a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.079726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-511022f6-ead8-4463-80be-4bd5d2609c2a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.079726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-511022f6-ead8-4463-80be-4bd5d2609c2a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.079726] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('511022f6-ead8-4463-80be-4bd5d2609c2a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.390148] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 1065.390399] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c deletion is rescheduled due to dependency. [ 1065.390691] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.390888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.391114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.391325] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.391424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.392506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.392506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.392506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.392506] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.519049] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38c2192a-d559-41a4-a489-c7aadce57b22 [ 1065.519124] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.519469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.519469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.519590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.519590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.519759] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38c2192a-d559-41a4-a489-c7aadce57b22 already deleted. [ 1065.519840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38c2192a-d559-41a4-a489-c7aadce57b22" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.582605] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.582756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.582958] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 511022f6-ead8-4463-80be-4bd5d2609c2a with status ACTIVE [ 1065.583184] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.583302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.583364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.583647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.583765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.583982] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.584118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.584201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.584511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.584511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.584719] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.584789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.584853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.587028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.587028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.587028] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 511022f6-ead8-4463-80be-4bd5d2609c2a is going to be updated. [ 1065.607227] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.609177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.609177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.609177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.609177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.609177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-511022f6-ead8-4463-80be-4bd5d2609c2a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.895431] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.397603] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.908627] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.908627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.908627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.908627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.908627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.908627] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be updated. [ 1066.934954] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.935899] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.936177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.936512] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.936796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.949096] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: IN_PROGRESS for 2s [ 1067.359035] env[70535]: INFO networking_nsxv3.common.synchronization [None req-2e268856-4164-4065-992c-90fd95fc3fa3 None None] Enqueued Resource ID: 14d2a6d4-e982-4fae-beaf-b221da325f1c with Priority: HIGHEST for action port [ 1067.359035] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14d2a6d4-e982-4fae-beaf-b221da325f1c with Priority: HIGHEST for action port [ 1067.359035] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-14d2a6d4-e982-4fae-beaf-b221da325f1c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.359035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14d2a6d4-e982-4fae-beaf-b221da325f1c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.359035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14d2a6d4-e982-4fae-beaf-b221da325f1c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.359035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14d2a6d4-e982-4fae-beaf-b221da325f1c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.359035] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14d2a6d4-e982-4fae-beaf-b221da325f1c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.859391] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14d2a6d4-e982-4fae-beaf-b221da325f1c [ 1067.859669] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.859810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.859894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.860239] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.860516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.860627] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14d2a6d4-e982-4fae-beaf-b221da325f1c already deleted. [ 1067.861031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14d2a6d4-e982-4fae-beaf-b221da325f1c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.961028] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 1068.961315] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.961457] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.961683] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.961882] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.962020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.962087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.962245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.962326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.962416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.962510] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.018863] env[70535]: INFO networking_nsxv3.common.synchronization [req-3ea31491-af8d-48b6-9948-2f4990b6c745 req-0773fffe-7764-49ff-8981-06b1229d475e tempest-AttachVolumeShelveTestJSON-2125264447 tempest-AttachVolumeShelveTestJSON-2125264447-project-member] Enqueued Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_members [ 1069.019619] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_members [ 1069.019763] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-76787551-efbb-4eb5-bef3-77685e9cde96 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.019895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.019953] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.022385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.022528] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.022645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.022709] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.023490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.023490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.023490] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.466743] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.480467] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.480713] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.480841] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.481150] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.481420] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.481583] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.481703] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.481920] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.482209] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.482437] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.482553] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.482662] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.482771] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.482881] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.482988] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.483136] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.502111] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.502915] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1069.503078] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.503291] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.503629] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-006653fe-4618-46c4-86f5-24f60e96ec81 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.503810] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.503937] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.504297] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.504439] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('006653fe-4618-46c4-86f5-24f60e96ec81',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.530326] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.530482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.530726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.530977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.531086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.531284] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.531665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.531665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.531665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.531665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.531863] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76787551-efbb-4eb5-bef3-77685e9cde96 already deleted. [ 1069.531863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.971424] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f0ce39e-83c0-4345-91bb-9366dd77a60c: rpc.has_security_group_logging(os_id): False [ 1069.990733] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.990952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.990952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.991142] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.991247] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.991596] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.991596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.991751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.991751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.991826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.991940] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be updated. [ 1070.007387] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.007663] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.007885] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.008097] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.008217] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.008376] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 006653fe-4618-46c4-86f5-24f60e96ec81 not found, creating... [ 1070.008660] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.009034] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.009034] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.009204] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.009323] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.009605] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.009905] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.009905] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.010105] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.010243] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.010388] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 006653fe-4618-46c4-86f5-24f60e96ec81 is going to be created. [ 1070.031082] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.031355] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.031445] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.031770] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.032138] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.032404] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.057552] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.057552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.057552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.057552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.057552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.070787] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: IN_PROGRESS for 2s [ 1070.382817] env[70535]: INFO networking_nsxv3.common.synchronization [None req-0295e461-5b09-4817-ab87-acc4ee39ade4 None None] Enqueued Resource ID: 21589e2d-f3ce-4c47-ac9c-59cb083118f2 with Priority: HIGHEST for action port [ 1070.383082] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21589e2d-f3ce-4c47-ac9c-59cb083118f2 with Priority: HIGHEST for action port [ 1070.384027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-21589e2d-f3ce-4c47-ac9c-59cb083118f2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.384027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21589e2d-f3ce-4c47-ac9c-59cb083118f2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.384027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21589e2d-f3ce-4c47-ac9c-59cb083118f2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.384275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21589e2d-f3ce-4c47-ac9c-59cb083118f2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.384275] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21589e2d-f3ce-4c47-ac9c-59cb083118f2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.888801] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21589e2d-f3ce-4c47-ac9c-59cb083118f2 [ 1070.889310] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.889310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.889310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.890323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.890323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.890323] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21589e2d-f3ce-4c47-ac9c-59cb083118f2 already deleted. [ 1070.890323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21589e2d-f3ce-4c47-ac9c-59cb083118f2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.221146] env[70535]: INFO networking_nsxv3.common.synchronization [req-3ea31491-af8d-48b6-9948-2f4990b6c745 req-b89dcb07-dd69-4d4f-bc08-1651200a38c6 service nova] Enqueued Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_rules [ 1071.221421] env[70535]: INFO networking_nsxv3.common.synchronization [req-3ea31491-af8d-48b6-9948-2f4990b6c745 req-b89dcb07-dd69-4d4f-bc08-1651200a38c6 service nova] Enqueued Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_members [ 1071.221471] env[70535]: INFO networking_nsxv3.common.synchronization [req-3ea31491-af8d-48b6-9948-2f4990b6c745 req-b89dcb07-dd69-4d4f-bc08-1651200a38c6 service nova] Enqueued Resource ID: 006653fe-4618-46c4-86f5-24f60e96ec81 with Priority: HIGHEST for action port [ 1071.221865] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_rules [ 1071.221927] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_members [ 1071.222013] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 006653fe-4618-46c4-86f5-24f60e96ec81 with Priority: HIGHEST for action port [ 1071.222644] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76787551-efbb-4eb5-bef3-77685e9cde96 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.222797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.222884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.224190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.224297] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.225758] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-76787551-efbb-4eb5-bef3-77685e9cde96 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.225917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.225988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.226236] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.226486] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.226805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.226805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.228602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.228602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.228602] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.228714] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-006653fe-4618-46c4-86f5-24f60e96ec81 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.228857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.228857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.229079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.229079] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('006653fe-4618-46c4-86f5-24f60e96ec81',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.733828] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-76787551-efbb-4eb5-bef3-77685e9cde96 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.733926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.734382] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.735248] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 006653fe-4618-46c4-86f5-24f60e96ec81 with status ACTIVE [ 1071.735504] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.735593] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.735634] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.738936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.738936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.738936] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.738936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.738936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.738936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.738936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.738936] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.738936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.738936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.738936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.738936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.738936] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 006653fe-4618-46c4-86f5-24f60e96ec81 is going to be updated. [ 1071.761552] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.762013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.762013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.762013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.762329] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.762329] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.093959] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 1072.094189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.240613] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.743182] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.743473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.743548] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.743769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.743862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.744167] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76787551-efbb-4eb5-bef3-77685e9cde96 is going to be created. [ 1072.766658] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.766875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.766875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.767116] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.767274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.777995] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76787551-efbb-4eb5-bef3-77685e9cde96 in Status: UNINITIALIZED for 2s [ 1072.817146] env[70535]: INFO networking_nsxv3.common.synchronization [None req-949f1568-4d45-4bb3-b20a-1e5493c79efc None None] Enqueued Resource ID: d7731dd0-6446-4406-a238-9017fb83d79e with Priority: HIGHEST for action port [ 1072.817620] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7731dd0-6446-4406-a238-9017fb83d79e with Priority: HIGHEST for action port [ 1072.818291] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7731dd0-6446-4406-a238-9017fb83d79e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.818498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7731dd0-6446-4406-a238-9017fb83d79e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.818568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7731dd0-6446-4406-a238-9017fb83d79e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.818836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7731dd0-6446-4406-a238-9017fb83d79e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.818922] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7731dd0-6446-4406-a238-9017fb83d79e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.323273] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7731dd0-6446-4406-a238-9017fb83d79e [ 1073.323704] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.323704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.323821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.323943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.324051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.324156] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7731dd0-6446-4406-a238-9017fb83d79e already deleted. [ 1073.324230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7731dd0-6446-4406-a238-9017fb83d79e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.808619] env[70535]: INFO networking_nsxv3.common.synchronization [req-3d62d2ad-8b3c-40ba-af6c-7e7d722ce05a req-bdadd1d1-b0a2-4ff8-95b6-0e0b3549ea5a tempest-ServerDiskConfigTestJSON-1021082095 tempest-ServerDiskConfigTestJSON-1021082095-project-member] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 1074.809175] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 1074.809487] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.809616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.809684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.809963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.810285] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.810398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.810463] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.810620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.810707] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.810800] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.886141] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76787551-efbb-4eb5-bef3-77685e9cde96 in Status: SUCCESS [ 1074.886141] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.886407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.887064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.888044] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.888197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.888288] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.888505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.888669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.888834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.889792] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.313282] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.313409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.313463] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.313706] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.313805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.314033] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.314322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.314322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.314482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.314482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.314567] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 1075.346477] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.346647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.346647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.346924] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.347345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.356847] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 1075.394289] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.898475] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76787551-efbb-4eb5-bef3-77685e9cde96: rpc.has_security_group_logging(os_id): False [ 1075.919648] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.919873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.919873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.920112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.920208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.920457] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.920565] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.920627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.920780] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.920856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.920941] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76787551-efbb-4eb5-bef3-77685e9cde96 is going to be created. [ 1075.984678] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.984927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.984927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.985203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.985298] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.996998] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76787551-efbb-4eb5-bef3-77685e9cde96 in Status: IN_PROGRESS for 2s [ 1077.002986] env[70535]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1077.003235] env[70535]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] NSXv3 Agent Agent loop - iteration:2 started [ 1077.367315] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 1077.367315] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 deletion is rescheduled due to dependency. [ 1077.367315] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.009872] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76787551-efbb-4eb5-bef3-77685e9cde96 in Status: SUCCESS [ 1078.010193] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.810193] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1079.810484] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1084.811856] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1084.812115] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1089.812804] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1089.813130] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1090.167193] env[70535]: INFO networking_nsxv3.common.synchronization [req-fd6c1fd7-d5d9-4bc8-a374-fab14091a221 req-4433afe2-84e4-40d7-a2de-bbef5c36b491 tempest-ServersAdminNegativeTestJSON-1138087894 tempest-ServersAdminNegativeTestJSON-1138087894-project-member] Enqueued Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_members [ 1090.167193] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_members [ 1090.167193] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.167193] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.167193] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.167896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.168191] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.168437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.168588] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.168909] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.169114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.169308] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.512662] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.512873] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.513061] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.513380] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.513661] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.513957] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.514121] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.514347] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.514506] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.514740] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.514866] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1090.514984] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1090.515115] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1090.515231] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.515342] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1090.515486] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1090.535549] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1090.535717] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1090.535876] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1090.536133] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.536467] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-245b0755-a4ae-4e7e-8834-e4bc1314c091 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.536650] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-245b0755-a4ae-4e7e-8834-e4bc1314c091" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.536803] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-245b0755-a4ae-4e7e-8834-e4bc1314c091" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.537155] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-245b0755-a4ae-4e7e-8834-e4bc1314c091" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.537300] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('245b0755-a4ae-4e7e-8834-e4bc1314c091',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.673328] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.673477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.673557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.673776] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.673874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.674094] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.674229] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.674372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.674449] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.674483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.674564] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efe16881-900e-4f34-a1b9-20cdccf84a3f already deleted. [ 1090.674642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.045020] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.045020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.045020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.045020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.045020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.045020] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 245b0755-a4ae-4e7e-8834-e4bc1314c091 not found, creating... [ 1091.045020] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.045020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.045020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.045020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.045020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.045657] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.045657] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.045657] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.045657] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.045657] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.045657] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 245b0755-a4ae-4e7e-8834-e4bc1314c091 is going to be created. [ 1091.066211] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.066864] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.067251] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.067963] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.068417] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.069069] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-245b0755-a4ae-4e7e-8834-e4bc1314c091" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.041464] env[70535]: INFO networking_nsxv3.common.synchronization [req-fd6c1fd7-d5d9-4bc8-a374-fab14091a221 req-bfd22030-f19e-400c-9351-f71e49b13d9c service nova] Enqueued Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_rules [ 1092.041660] env[70535]: INFO networking_nsxv3.common.synchronization [req-fd6c1fd7-d5d9-4bc8-a374-fab14091a221 req-bfd22030-f19e-400c-9351-f71e49b13d9c service nova] Enqueued Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_members [ 1092.041754] env[70535]: INFO networking_nsxv3.common.synchronization [req-fd6c1fd7-d5d9-4bc8-a374-fab14091a221 req-bfd22030-f19e-400c-9351-f71e49b13d9c service nova] Enqueued Resource ID: 245b0755-a4ae-4e7e-8834-e4bc1314c091 with Priority: HIGHEST for action port [ 1092.041981] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_rules [ 1092.042125] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_members [ 1092.042223] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245b0755-a4ae-4e7e-8834-e4bc1314c091 with Priority: HIGHEST for action port [ 1092.042750] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.042881] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.042947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.043447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.043534] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.044748] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.045010] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.045088] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.045260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.045406] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.045503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.045627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.045732] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.045820] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.045905] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.050271] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-245b0755-a4ae-4e7e-8834-e4bc1314c091 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.050393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-245b0755-a4ae-4e7e-8834-e4bc1314c091" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.050462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-245b0755-a4ae-4e7e-8834-e4bc1314c091" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.050623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-245b0755-a4ae-4e7e-8834-e4bc1314c091" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.050703] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('245b0755-a4ae-4e7e-8834-e4bc1314c091',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.430028] env[70535]: INFO networking_nsxv3.common.synchronization [req-09edb7bc-cdb5-4bb4-8e53-d728208a2770 req-05c980da-645b-4437-8430-99c5940a8b57 tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_members [ 1092.430542] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_members [ 1092.430846] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f11229e-4f65-4aab-a492-ad9dd37f60f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.430974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.431116] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.431380] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.431539] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.431639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.431702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.431886] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.431976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.432084] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.545219] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.545355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.550792] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.555470] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 245b0755-a4ae-4e7e-8834-e4bc1314c091 with status ACTIVE [ 1092.555758] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.557022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.557022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.557022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.557022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.557022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.557022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.557022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.557022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.557022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.557352] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.557352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.557352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.557464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.557464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.557516] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 245b0755-a4ae-4e7e-8834-e4bc1314c091 is going to be updated. [ 1092.579368] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.579566] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.579566] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.579781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.579916] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.580082] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-245b0755-a4ae-4e7e-8834-e4bc1314c091" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.759195] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.759195] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.759195] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.759195] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.759195] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.759195] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.759601] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.759601] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.759648] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.760183] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1092.760183] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.760290] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.760317] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.760413] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1092.760516] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.760648] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.779095] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.779340] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1092.779666] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.779666] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.780011] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-7630e33a-869a-40f9-be96-f2b797bdb627 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.780251] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-7630e33a-869a-40f9-be96-f2b797bdb627" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.780383] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-7630e33a-869a-40f9-be96-f2b797bdb627" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.780709] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-7630e33a-869a-40f9-be96-f2b797bdb627" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.780855] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7630e33a-869a-40f9-be96-f2b797bdb627',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.937836] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.938035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.938118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.938330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.938418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.938611] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.938775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.938775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.938947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.939036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.939125] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 already deleted. [ 1092.939206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.053597] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.283493] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.283750] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.283893] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.284289] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.284369] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.284525] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 7630e33a-869a-40f9-be96-f2b797bdb627 not found, creating... [ 1093.284794] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.285028] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.285182] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.285412] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.285593] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.285935] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.286112] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.286235] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.286475] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.286636] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.286795] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 7630e33a-869a-40f9-be96-f2b797bdb627 is going to be created. [ 1093.308166] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.308377] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.308516] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.308906] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.309164] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.309401] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-7630e33a-869a-40f9-be96-f2b797bdb627" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.558184] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.558359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.558433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.558666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.558786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.558889] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efe16881-900e-4f34-a1b9-20cdccf84a3f is going to be created. [ 1093.586454] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.586631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.586670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.586886] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.587062] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.605240] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efe16881-900e-4f34-a1b9-20cdccf84a3f in Status: UNINITIALIZED for 2s [ 1094.308029] env[70535]: INFO networking_nsxv3.common.synchronization [req-09edb7bc-cdb5-4bb4-8e53-d728208a2770 req-cedb0819-1ca3-49f1-91fc-3416ce69bde8 service nova] Enqueued Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_rules [ 1094.308029] env[70535]: INFO networking_nsxv3.common.synchronization [req-09edb7bc-cdb5-4bb4-8e53-d728208a2770 req-cedb0819-1ca3-49f1-91fc-3416ce69bde8 service nova] Enqueued Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_members [ 1094.308029] env[70535]: INFO networking_nsxv3.common.synchronization [req-09edb7bc-cdb5-4bb4-8e53-d728208a2770 req-cedb0819-1ca3-49f1-91fc-3416ce69bde8 service nova] Enqueued Resource ID: 7630e33a-869a-40f9-be96-f2b797bdb627 with Priority: HIGHEST for action port [ 1094.308029] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_rules [ 1094.308029] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_members [ 1094.308029] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7630e33a-869a-40f9-be96-f2b797bdb627 with Priority: HIGHEST for action port [ 1094.308029] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.308029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.308029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.308029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.308029] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.309580] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f11229e-4f65-4aab-a492-ad9dd37f60f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.309812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.309955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.310301] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.310524] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.310710] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.310835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.311052] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.311211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.311360] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.312383] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-7630e33a-869a-40f9-be96-f2b797bdb627 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.312607] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7630e33a-869a-40f9-be96-f2b797bdb627" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.312753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7630e33a-869a-40f9-be96-f2b797bdb627" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.313000] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7630e33a-869a-40f9-be96-f2b797bdb627" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.313176] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7630e33a-869a-40f9-be96-f2b797bdb627',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.818032] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f11229e-4f65-4aab-a492-ad9dd37f60f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.818032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.818032] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.818032] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7630e33a-869a-40f9-be96-f2b797bdb627 with status ACTIVE [ 1094.818032] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.818032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.818032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.818032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.818032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.818032] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.818032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.818032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.818430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.818430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.818430] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.818514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.818541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.818758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.818817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.818875] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7630e33a-869a-40f9-be96-f2b797bdb627 is going to be updated. [ 1094.840939] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.842101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.842101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.842101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.842101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.842101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7630e33a-869a-40f9-be96-f2b797bdb627" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.065387] env[70535]: INFO networking_nsxv3.common.synchronization [None req-779f4f58-00c6-467f-ab42-7b0f4d5b2430 None None] Enqueued Resource ID: 103e9b90-31de-41cd-bcf5-c030c33ac388 with Priority: HIGHEST for action port [ 1095.066726] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103e9b90-31de-41cd-bcf5-c030c33ac388 with Priority: HIGHEST for action port [ 1095.067605] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-103e9b90-31de-41cd-bcf5-c030c33ac388 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.068363] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-103e9b90-31de-41cd-bcf5-c030c33ac388" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.068498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-103e9b90-31de-41cd-bcf5-c030c33ac388" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.068990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-103e9b90-31de-41cd-bcf5-c030c33ac388" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.069123] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('103e9b90-31de-41cd-bcf5-c030c33ac388',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.320632] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.571293] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 103e9b90-31de-41cd-bcf5-c030c33ac388 [ 1095.571541] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.571678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.571777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.571978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.572147] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.572266] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:103e9b90-31de-41cd-bcf5-c030c33ac388 already deleted. [ 1095.572357] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-103e9b90-31de-41cd-bcf5-c030c33ac388" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.617471] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efe16881-900e-4f34-a1b9-20cdccf84a3f in Status: SUCCESS [ 1095.617832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.618387] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.618619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.618836] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.618987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.619077] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.619205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.619288] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.619372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.619462] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.823674] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.823803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.823851] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.824123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.824222] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.824322] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 is going to be created. [ 1095.853663] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.853935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.853935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.854280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.854648] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.871147] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 in Status: UNINITIALIZED for 2s [ 1096.123773] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.123966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.124041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.125029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.125029] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.125029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.125029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.125029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.125029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.125029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.125029] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.125400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.125400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.125400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.125484] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.125528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.125559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.125741] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.125850] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.125903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.126076] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.629095] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efe16881-900e-4f34-a1b9-20cdccf84a3f: rpc.has_security_group_logging(os_id): False [ 1096.647134] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.647266] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.647356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.647546] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.647640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.647872] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.647969] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.648047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.648195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.648272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.648542] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.648630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.648630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.648813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.648884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.649032] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.649128] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.649189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.649327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.649399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.649481] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efe16881-900e-4f34-a1b9-20cdccf84a3f is going to be created. [ 1096.712993] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.712993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.712993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.712993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.712993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.725726] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efe16881-900e-4f34-a1b9-20cdccf84a3f in Status: IN_PROGRESS for 2s [ 1097.297067] env[70535]: INFO networking_nsxv3.common.synchronization [None req-58000864-2341-444f-9ef1-b72e30bbc709 None None] Enqueued Resource ID: fc9ee0ea-4373-48e0-bb6e-5c903342f01c with Priority: HIGHEST for action port [ 1097.297335] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc9ee0ea-4373-48e0-bb6e-5c903342f01c with Priority: HIGHEST for action port [ 1097.298014] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc9ee0ea-4373-48e0-bb6e-5c903342f01c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.298260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc9ee0ea-4373-48e0-bb6e-5c903342f01c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.298366] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc9ee0ea-4373-48e0-bb6e-5c903342f01c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.298666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc9ee0ea-4373-48e0-bb6e-5c903342f01c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.298789] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc9ee0ea-4373-48e0-bb6e-5c903342f01c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.389641] env[70535]: INFO networking_nsxv3.common.synchronization [req-c480ff05-c752-4b13-91ea-5d17796b13bf req-3e748498-0341-4f32-bf49-bd9bf3be9af5 tempest-ServerRescueNegativeTestJSON-1204437415 tempest-ServerRescueNegativeTestJSON-1204437415-project-member] Enqueued Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_members [ 1097.396597] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_members [ 1097.396597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.396597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.396597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.396597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.396597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.396597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.396597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.396597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.396597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.396597] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.804946] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc9ee0ea-4373-48e0-bb6e-5c903342f01c [ 1097.804946] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.804946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.804946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.804946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.804946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.804946] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc9ee0ea-4373-48e0-bb6e-5c903342f01c already deleted. [ 1097.804946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc9ee0ea-4373-48e0-bb6e-5c903342f01c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.881681] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 in Status: SUCCESS [ 1097.881681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.881956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.881956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.883089] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.883089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.883089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.883089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.883089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.883089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.883089] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.900793] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.900972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.901058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.901270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.901360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.901553] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.901651] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.901785] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.901961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.902056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.902142] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edae0da3-713a-4ce1-bb9b-f814f5976678 already deleted. [ 1097.902223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.225945] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.226264] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-281" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.226297] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-281" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.227182] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-281" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.227182] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.227182] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.227182] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.227470] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.227534] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.227784] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1098.227865] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.227988] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.228130] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.228272] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1098.228349] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.228486] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1098.249931] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1098.250134] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1098.250273] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1098.250463] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-281" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.250784] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-15be8e29-fa05-4b1e-9ade-a4d8ac3fb487 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.251408] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-15be8e29-fa05-4b1e-9ade-a4d8ac3fb487" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.251408] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-15be8e29-fa05-4b1e-9ade-a4d8ac3fb487" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.251505] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-15be8e29-fa05-4b1e-9ade-a4d8ac3fb487" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.251580] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15be8e29-fa05-4b1e-9ade-a4d8ac3fb487',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.384502] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.738919] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efe16881-900e-4f34-a1b9-20cdccf84a3f in Status: SUCCESS [ 1098.739245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.754548] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.754804] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.754901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.755326] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.755389] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.755584] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 15be8e29-fa05-4b1e-9ade-a4d8ac3fb487 not found, creating... [ 1098.755814] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.755999] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.756135] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.756553] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.756553] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.756790] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.756957] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.757141] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.757364] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.757642] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.757642] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 15be8e29-fa05-4b1e-9ade-a4d8ac3fb487 is going to be created. [ 1098.777940] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.778217] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.778341] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.778616] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.778887] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.779142] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-15be8e29-fa05-4b1e-9ade-a4d8ac3fb487" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.887020] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f11229e-4f65-4aab-a492-ad9dd37f60f1: rpc.has_security_group_logging(os_id): False [ 1098.921027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.921027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.921027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.921027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.921027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.921027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.921027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.921027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.921027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.921027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.921027] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 is going to be created. [ 1099.011038] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.011038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.011038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.011483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.011674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.026189] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 in Status: IN_PROGRESS for 2s [ 1099.590340] env[70535]: INFO networking_nsxv3.common.synchronization [req-c480ff05-c752-4b13-91ea-5d17796b13bf req-be646116-92c5-4368-8f3e-49bf68182f72 service nova] Enqueued Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_rules [ 1099.590340] env[70535]: INFO networking_nsxv3.common.synchronization [req-c480ff05-c752-4b13-91ea-5d17796b13bf req-be646116-92c5-4368-8f3e-49bf68182f72 service nova] Enqueued Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_members [ 1099.590893] env[70535]: INFO networking_nsxv3.common.synchronization [req-c480ff05-c752-4b13-91ea-5d17796b13bf req-be646116-92c5-4368-8f3e-49bf68182f72 service nova] Enqueued Resource ID: 15be8e29-fa05-4b1e-9ade-a4d8ac3fb487 with Priority: HIGHEST for action port [ 1099.590893] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_rules [ 1099.590893] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_members [ 1099.591013] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15be8e29-fa05-4b1e-9ade-a4d8ac3fb487 with Priority: HIGHEST for action port [ 1099.600482] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.600482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.600482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.600482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.600482] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.600482] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.600482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.600482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.600482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.600482] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.600832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.600832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.600832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.600908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.600943] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.602272] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-15be8e29-fa05-4b1e-9ade-a4d8ac3fb487 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.602388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15be8e29-fa05-4b1e-9ade-a4d8ac3fb487" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.602450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15be8e29-fa05-4b1e-9ade-a4d8ac3fb487" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.604816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15be8e29-fa05-4b1e-9ade-a4d8ac3fb487" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.604816] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15be8e29-fa05-4b1e-9ade-a4d8ac3fb487',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.884641] env[70535]: INFO networking_nsxv3.common.synchronization [req-8daab78c-b2ab-4c82-8d9d-52cf56179424 req-f6db2d9f-e874-450d-9e1f-274faaa4bdc7 tempest-ServerRescueNegativeTestJSON-1204437415 tempest-ServerRescueNegativeTestJSON-1204437415-project-member] Enqueued Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_members [ 1099.885196] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_members [ 1099.885500] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.885597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.108194] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.108194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.108194] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.108194] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15be8e29-fa05-4b1e-9ade-a4d8ac3fb487 with status ACTIVE [ 1100.108194] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.108194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.108194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.108194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.108194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.108194] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.108194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.108194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.108194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.108194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.108840] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.108840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.108840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.108840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.108840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.108840] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15be8e29-fa05-4b1e-9ade-a4d8ac3fb487 is going to be updated. [ 1100.131700] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.131865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.131936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.132176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.132322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.132484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15be8e29-fa05-4b1e-9ade-a4d8ac3fb487" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.219926] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.220205] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-281" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.220335] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-281" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.220630] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-281" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.220960] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.222046] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.222046] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.222046] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.222046] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.222046] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1100.222347] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.222347] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.222625] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.222735] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1100.222866] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.223046] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1100.244147] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1100.244445] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1100.244596] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1100.244810] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-281" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.245159] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-fa43fa94-17ba-415d-93dc-08f24ff80781 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.245340] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-fa43fa94-17ba-415d-93dc-08f24ff80781" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.245466] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-fa43fa94-17ba-415d-93dc-08f24ff80781" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.245859] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-fa43fa94-17ba-415d-93dc-08f24ff80781" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.246029] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa43fa94-17ba-415d-93dc-08f24ff80781',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.611640] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.749085] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.749363] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.749533] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.749783] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.749939] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.750111] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port fa43fa94-17ba-415d-93dc-08f24ff80781 not found, creating... [ 1100.750969] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.750969] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.750969] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.750969] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.751158] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.751292] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.751449] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.751569] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.751782] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.752080] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.752146] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: fa43fa94-17ba-415d-93dc-08f24ff80781 is going to be created. [ 1100.772440] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.772667] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.772798] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.773095] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.773355] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.773617] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-fa43fa94-17ba-415d-93dc-08f24ff80781" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.043346] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 in Status: SUCCESS [ 1101.043465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.114304] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.114564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.114564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.114841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.114841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.114942] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edae0da3-713a-4ce1-bb9b-f814f5976678 is going to be created. [ 1101.141159] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.141159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.141159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.141413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.141413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.153623] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edae0da3-713a-4ce1-bb9b-f814f5976678 in Status: UNINITIALIZED for 2s [ 1101.503816] env[70535]: INFO networking_nsxv3.common.synchronization [req-8daab78c-b2ab-4c82-8d9d-52cf56179424 req-6cd9ec0c-9418-4624-82e3-9ee78613a9d7 service nova] Enqueued Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_rules [ 1101.504086] env[70535]: INFO networking_nsxv3.common.synchronization [req-8daab78c-b2ab-4c82-8d9d-52cf56179424 req-6cd9ec0c-9418-4624-82e3-9ee78613a9d7 service nova] Enqueued Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_members [ 1101.504202] env[70535]: INFO networking_nsxv3.common.synchronization [req-8daab78c-b2ab-4c82-8d9d-52cf56179424 req-6cd9ec0c-9418-4624-82e3-9ee78613a9d7 service nova] Enqueued Resource ID: fa43fa94-17ba-415d-93dc-08f24ff80781 with Priority: HIGHEST for action port [ 1101.504696] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_rules [ 1101.504832] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_members [ 1101.504930] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa43fa94-17ba-415d-93dc-08f24ff80781 with Priority: HIGHEST for action port [ 1101.505672] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.505802] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.506019] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.506101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.506293] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa43fa94-17ba-415d-93dc-08f24ff80781 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.506397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa43fa94-17ba-415d-93dc-08f24ff80781" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.506455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa43fa94-17ba-415d-93dc-08f24ff80781" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.506663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa43fa94-17ba-415d-93dc-08f24ff80781" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.506800] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa43fa94-17ba-415d-93dc-08f24ff80781',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.008733] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa43fa94-17ba-415d-93dc-08f24ff80781 with status ACTIVE [ 1102.008906] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.009123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.009239] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.009509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.009655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.009888] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.010362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.010362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.010362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.010479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.010712] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.011737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.011737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.011737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.011737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.011737] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa43fa94-17ba-415d-93dc-08f24ff80781 is going to be updated. [ 1102.037385] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.037576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.037755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.038075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.038287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.038478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa43fa94-17ba-415d-93dc-08f24ff80781" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.571936] env[70535]: INFO networking_nsxv3.common.synchronization [req-c50becdd-3e15-4743-b43b-5f3bad78e3a2 req-2c854702-28fc-4aad-a91b-c4083fa348ec tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_members [ 1102.571936] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_members [ 1102.571936] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.572307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.572307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.572385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.572601] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.572601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.572707] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.572901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.572901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.572995] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.077552] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.077707] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.077782] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.078036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.101561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.101850] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.102027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.102095] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.102278] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.102360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.102452] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 is going to be updated. [ 1103.127103] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.127270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.127339] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.128324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.128324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.136744] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 in Status: IN_PROGRESS for 2s [ 1103.164083] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edae0da3-713a-4ce1-bb9b-f814f5976678 in Status: SUCCESS [ 1103.164321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.164499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.164733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.164929] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.165064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.165120] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.165270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.165352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.165516] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.431676] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.431869] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.431993] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.432277] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.432905] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.433195] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.433342] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.433564] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.433713] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.435758] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1103.435758] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1103.435758] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1103.435758] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1103.435758] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1103.435758] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1103.435758] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1103.454849] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1103.455041] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1103.455168] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1103.455343] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.456160] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-b39fab32-95ce-4df1-9e31-354b0d00d187 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.456160] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-b39fab32-95ce-4df1-9e31-354b0d00d187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.456419] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-b39fab32-95ce-4df1-9e31-354b0d00d187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.456589] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-b39fab32-95ce-4df1-9e31-354b0d00d187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.456746] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b39fab32-95ce-4df1-9e31-354b0d00d187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.668772] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.959319] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.959542] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.959675] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.959972] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.960227] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.960403] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port b39fab32-95ce-4df1-9e31-354b0d00d187 not found, creating... [ 1103.960677] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.960842] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.960966] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.961234] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.961379] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.961669] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.961829] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.961951] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.962188] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.962330] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.962473] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: b39fab32-95ce-4df1-9e31-354b0d00d187 is going to be created. [ 1103.984785] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.985043] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.985176] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.985459] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.985736] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.985943] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-b39fab32-95ce-4df1-9e31-354b0d00d187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.171538] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.679090] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.679090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.679090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.679090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.679090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.679090] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edae0da3-713a-4ce1-bb9b-f814f5976678 is going to be updated. [ 1104.709417] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.709417] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.709417] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.709740] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.709784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.722114] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edae0da3-713a-4ce1-bb9b-f814f5976678 in Status: IN_PROGRESS for 2s [ 1104.784783] env[70535]: INFO networking_nsxv3.common.synchronization [req-c50becdd-3e15-4743-b43b-5f3bad78e3a2 req-8276f2de-5011-4329-8ac5-734eb65dc8c5 service nova] Enqueued Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_rules [ 1104.784973] env[70535]: INFO networking_nsxv3.common.synchronization [req-c50becdd-3e15-4743-b43b-5f3bad78e3a2 req-8276f2de-5011-4329-8ac5-734eb65dc8c5 service nova] Enqueued Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_members [ 1104.785144] env[70535]: INFO networking_nsxv3.common.synchronization [req-c50becdd-3e15-4743-b43b-5f3bad78e3a2 req-8276f2de-5011-4329-8ac5-734eb65dc8c5 service nova] Enqueued Resource ID: b39fab32-95ce-4df1-9e31-354b0d00d187 with Priority: HIGHEST for action port [ 1104.785362] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_rules [ 1104.785486] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_members [ 1104.785583] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b39fab32-95ce-4df1-9e31-354b0d00d187 with Priority: HIGHEST for action port [ 1104.788848] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.789046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.789160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.789276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.789366] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.794246] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.794246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.794246] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-b39fab32-95ce-4df1-9e31-354b0d00d187 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.794246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b39fab32-95ce-4df1-9e31-354b0d00d187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.794246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b39fab32-95ce-4df1-9e31-354b0d00d187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.794246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b39fab32-95ce-4df1-9e31-354b0d00d187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.794246] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b39fab32-95ce-4df1-9e31-354b0d00d187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.930684] env[70535]: INFO networking_nsxv3.common.synchronization [req-405f6f79-bd6b-4222-b2d9-a66131f4a1ac req-4bba0232-9375-4973-933c-52b9e53a1a6d tempest-ListServerFiltersTestJSON-136218615 tempest-ListServerFiltersTestJSON-136218615-project-member] Enqueued Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1104.931990] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1104.933598] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.933811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.933908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.934480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.934717] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.934862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.934945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.935221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.935396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.935555] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.150027] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 in Status: SUCCESS [ 1105.150027] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 deletion is rescheduled due to dependency. [ 1105.150398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.150398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.150547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.150741] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.150864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.150934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.151508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.151605] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.151710] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.297148] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.297148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.301129] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b39fab32-95ce-4df1-9e31-354b0d00d187 with status ACTIVE [ 1105.301129] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.301129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.301129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.301129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.301129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.301129] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.301129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.301129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.301129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.301516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.301516] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.301586] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.301614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.301795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.301900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.302216] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b39fab32-95ce-4df1-9e31-354b0d00d187 is going to be updated. [ 1105.328345] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.328543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.328627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.328854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.329010] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.329198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b39fab32-95ce-4df1-9e31-354b0d00d187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.423797] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-944 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.424759] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-944" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.425038] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-944" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.425448] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-944" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.425829] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.426406] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.426406] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.426542] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.426690] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.426942] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.427123] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.427268] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.427411] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.427560] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.427694] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.427905] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.439547] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.439981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.439981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.439981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.439981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.440439] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.440600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.440686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.440935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.441135] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.441447] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e already deleted. [ 1105.441447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.504232] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.504232] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.076 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1105.504232] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.504232] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-944" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.504232] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-d2aeb34e-4a4b-4fa9-ad19-67e6df85597f taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.505344] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-d2aeb34e-4a4b-4fa9-ad19-67e6df85597f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.505491] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-d2aeb34e-4a4b-4fa9-ad19-67e6df85597f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.505912] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-d2aeb34e-4a4b-4fa9-ad19-67e6df85597f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.506082] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2aeb34e-4a4b-4fa9-ad19-67e6df85597f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.654599] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.009175] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.009557] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.009557] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.009876] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.010063] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.010420] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port d2aeb34e-4a4b-4fa9-ad19-67e6df85597f not found, creating... [ 1106.010575] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.010719] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.010843] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.011184] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.011257] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.011561] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.011860] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.011860] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.012141] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.012222] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.012434] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: d2aeb34e-4a4b-4fa9-ad19-67e6df85597f is going to be created. [ 1106.036762] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.036996] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.037147] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.037438] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.037679] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.037996] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-d2aeb34e-4a4b-4fa9-ad19-67e6df85597f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.156812] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.660173] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.660378] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.660477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.660757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.660879] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.661013] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 is going to be updated. [ 1106.696962] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.697168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.697219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.697393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.697538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.708738] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 in Status: IN_PROGRESS for 2s [ 1106.732709] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edae0da3-713a-4ce1-bb9b-f814f5976678 in Status: SUCCESS [ 1106.732953] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.733528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.735817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.735817] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.735817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.735817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.735817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.735817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.735817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.735817] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.735817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.736178] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.737037] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.737037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.737037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.737037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.737037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.737037] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.797022] env[70535]: INFO networking_nsxv3.common.synchronization [req-405f6f79-bd6b-4222-b2d9-a66131f4a1ac req-bec4a0a5-5009-497c-b6d8-81fb79766104 service nova] Enqueued Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_rules [ 1106.797022] env[70535]: INFO networking_nsxv3.common.synchronization [req-405f6f79-bd6b-4222-b2d9-a66131f4a1ac req-bec4a0a5-5009-497c-b6d8-81fb79766104 service nova] Enqueued Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1106.797022] env[70535]: INFO networking_nsxv3.common.synchronization [req-405f6f79-bd6b-4222-b2d9-a66131f4a1ac req-bec4a0a5-5009-497c-b6d8-81fb79766104 service nova] Enqueued Resource ID: d2aeb34e-4a4b-4fa9-ad19-67e6df85597f with Priority: HIGHEST for action port [ 1106.797022] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_rules [ 1106.797022] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1106.797022] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2aeb34e-4a4b-4fa9-ad19-67e6df85597f with Priority: HIGHEST for action port [ 1106.797789] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.798165] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.798336] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.798679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.798887] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.800013] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.800269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.801218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.801218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.801218] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.801218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.801578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.801836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.802053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.804091] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.804091] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2aeb34e-4a4b-4fa9-ad19-67e6df85597f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.804091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2aeb34e-4a4b-4fa9-ad19-67e6df85597f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.804091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2aeb34e-4a4b-4fa9-ad19-67e6df85597f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.804091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2aeb34e-4a4b-4fa9-ad19-67e6df85597f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.804091] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2aeb34e-4a4b-4fa9-ad19-67e6df85597f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.238930] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.239399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.239399] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.305564] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.305793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.308256] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.309276] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2aeb34e-4a4b-4fa9-ad19-67e6df85597f with status ACTIVE [ 1107.309561] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.309649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.309720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.309959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.310076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.310294] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.310392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.310465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.310606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.310697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.311019] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.314591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.314736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.314970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.315109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.315211] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2aeb34e-4a4b-4fa9-ad19-67e6df85597f is going to be updated. [ 1107.343363] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.343633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.343695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.343918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.344291] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.344512] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2aeb34e-4a4b-4fa9-ad19-67e6df85597f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.658808] env[70535]: INFO networking_nsxv3.common.synchronization [req-91109e8c-eac3-4736-a342-d69ad5a3d190 req-774a7c93-9e53-4dbf-91b2-2c289aba3383 tempest-ListServerFiltersTestJSON-136218615 tempest-ListServerFiltersTestJSON-136218615-project-member] Enqueued Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1107.659377] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1107.660122] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.660244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.743339] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.817663] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.070027] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-944 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.070027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-944" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.070027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-944" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.070027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-944" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.070027] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.070027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.070027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.070027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.070027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.070027] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1108.070027] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1108.070027] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1108.070027] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1108.070531] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1108.070531] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1108.070531] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1108.089614] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1108.089806] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1108.089942] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1108.090174] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-944" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.091547] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-d4f2d141-40f9-4214-992b-377a73580ddc taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.091547] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-d4f2d141-40f9-4214-992b-377a73580ddc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.091547] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-d4f2d141-40f9-4214-992b-377a73580ddc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.091754] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-d4f2d141-40f9-4214-992b-377a73580ddc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.092595] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4f2d141-40f9-4214-992b-377a73580ddc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.245301] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.245816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.245816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.245816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.246021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.246176] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edae0da3-713a-4ce1-bb9b-f814f5976678 is going to be updated. [ 1108.279617] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.279776] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.279849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.280194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.280420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.297307] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edae0da3-713a-4ce1-bb9b-f814f5976678 in Status: IN_PROGRESS for 2s [ 1108.321763] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.321972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.322090] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.322408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.322565] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.322743] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e is going to be created. [ 1108.358074] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.358344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.358398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.358721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.358956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.380037] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: UNINITIALIZED for 2s [ 1108.594238] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.594573] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.594573] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.594908] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.595034] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.595279] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port d4f2d141-40f9-4214-992b-377a73580ddc not found, creating... [ 1108.595420] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.595875] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.595875] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.596373] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.596373] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.596506] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.596692] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.596784] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.598854] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.598854] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.598854] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: d4f2d141-40f9-4214-992b-377a73580ddc is going to be created. [ 1108.624344] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.624707] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.624944] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.625377] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.626938] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.626938] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-d4f2d141-40f9-4214-992b-377a73580ddc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.730275] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 in Status: SUCCESS [ 1108.731287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.731287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.731287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.731556] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.731787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.731899] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.732219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.732294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.732397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.732515] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.238563] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.238563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.238563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.238563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.238563] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.238563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.238563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.238563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.238563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.238563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.238563] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.238563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.238563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.238563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.238563] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.238563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.239405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.239405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.239405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.239405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.239405] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.364956] env[70535]: INFO networking_nsxv3.common.synchronization [req-91109e8c-eac3-4736-a342-d69ad5a3d190 req-8587d17f-15a9-44ef-b67c-97ed3fb27c51 service nova] Enqueued Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_rules [ 1109.364956] env[70535]: INFO networking_nsxv3.common.synchronization [req-91109e8c-eac3-4736-a342-d69ad5a3d190 req-8587d17f-15a9-44ef-b67c-97ed3fb27c51 service nova] Enqueued Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1109.364956] env[70535]: INFO networking_nsxv3.common.synchronization [req-91109e8c-eac3-4736-a342-d69ad5a3d190 req-8587d17f-15a9-44ef-b67c-97ed3fb27c51 service nova] Enqueued Resource ID: d4f2d141-40f9-4214-992b-377a73580ddc with Priority: HIGHEST for action port [ 1109.364956] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_rules [ 1109.364956] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1109.365937] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f2d141-40f9-4214-992b-377a73580ddc with Priority: HIGHEST for action port [ 1109.365994] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.366181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.366395] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.366486] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.366640] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4f2d141-40f9-4214-992b-377a73580ddc taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.366782] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4f2d141-40f9-4214-992b-377a73580ddc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.366846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4f2d141-40f9-4214-992b-377a73580ddc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.367065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4f2d141-40f9-4214-992b-377a73580ddc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.367148] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4f2d141-40f9-4214-992b-377a73580ddc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.742713] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8d7fb02-d4e1-40c2-a711-afb7188e3a15: rpc.has_security_group_logging(os_id): False [ 1109.761658] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.761831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.762468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.762468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.762468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.762468] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.762777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.762777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.762777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.762877] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.763778] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.763778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.763778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.763778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.763778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.763778] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.763778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.764342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.765060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.765060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.765060] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 is going to be updated. [ 1109.845474] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.845474] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.845692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.845981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.846077] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.863082] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 in Status: IN_PROGRESS for 2s [ 1109.870443] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4f2d141-40f9-4214-992b-377a73580ddc with status ACTIVE [ 1109.870732] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.870884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.870950] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.871314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.871384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.871648] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.871806] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.872181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.872476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.872625] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.872895] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.873079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.873164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.873365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.873493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.873633] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4f2d141-40f9-4214-992b-377a73580ddc is going to be updated. [ 1109.898512] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.898799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.898799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.899087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.899184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.899372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4f2d141-40f9-4214-992b-377a73580ddc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.167024] env[70535]: INFO networking_nsxv3.common.synchronization [req-4bb0042b-6aee-4bb6-999f-e245eb7b025c req-fffa43eb-daa4-403b-b638-417dcb2ce95e tempest-ServersTestMultiNic-1028446262 tempest-ServersTestMultiNic-1028446262-project-member] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1110.167697] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1110.170935] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.171122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.171196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.171455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.171629] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.171731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.171795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.171945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.172062] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.172193] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.314055] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edae0da3-713a-4ce1-bb9b-f814f5976678 in Status: SUCCESS [ 1110.314818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.314818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.314818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.315066] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.315066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.315066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.315267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.315317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.315410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.315663] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.315747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.315796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.315952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.316173] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.316272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.316272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.316390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.316469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.316548] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.316638] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.390727] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: SUCCESS [ 1110.391026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.391195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.391458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.391686] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.391847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.391929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.392179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.392273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.392419] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.392467] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.393690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.393690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.393852] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.393976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.394073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.394241] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.394342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.394449] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.530140] env[70535]: INFO networking_nsxv3.common.synchronization [req-4bb0042b-6aee-4bb6-999f-e245eb7b025c req-e445985c-060a-4719-b166-22c9b60445f8 tempest-ServersTestMultiNic-1028446262 tempest-ServersTestMultiNic-1028446262-project-member] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1110.530140] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1110.530140] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.530140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.677987] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.677987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.677987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.678263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.678263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.679071] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.679071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.679071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.679071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.679071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.679071] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af already deleted. [ 1110.679071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.679071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.679455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.679455] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.679455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.679560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.679737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.679737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.679814] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.819207] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edae0da3-713a-4ce1-bb9b-f814f5976678: rpc.has_security_group_logging(os_id): False [ 1110.842243] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.842243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.842243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.842243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.842243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.842786] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.843124] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.843289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.845457] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.845647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.845936] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.846157] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.846296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.846579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.846738] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.847156] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.848453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.848453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.848453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.848453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.848453] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edae0da3-713a-4ce1-bb9b-f814f5976678 is going to be created. [ 1110.896969] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.897155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.897371] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.906500] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.906940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.906940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.907098] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.907170] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.914786] env[70535]: INFO networking_nsxv3.common.synchronization [req-4bb0042b-6aee-4bb6-999f-e245eb7b025c req-fc340da5-7919-462a-9a4d-df3dc53f48c9 tempest-ServersTestMultiNic-1028446262 tempest-ServersTestMultiNic-1028446262-project-member] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1110.915845] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1110.916228] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.916339] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.919949] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edae0da3-713a-4ce1-bb9b-f814f5976678 in Status: IN_PROGRESS for 2s [ 1111.182168] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.182391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.182391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.182688] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.182788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.183159] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.183369] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.183435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.183658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.183794] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.183977] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af already deleted. [ 1111.184131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.184388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.184706] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.185067] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.186822] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.186926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.187115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.187192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.187471] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.333553] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-721 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.333765] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-721" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.333765] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-721" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.335874] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-721" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.336358] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.336814] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.336814] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.337127] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.337374] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.338037] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.338037] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.338037] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.338037] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.338232] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.338263] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.338451] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.363778] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.363973] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1111.364161] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.364508] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-721" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.365020] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-36d222a7-3a24-40cd-8370-da58c978c569 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.365276] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-36d222a7-3a24-40cd-8370-da58c978c569" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.365419] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-36d222a7-3a24-40cd-8370-da58c978c569" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.365907] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-36d222a7-3a24-40cd-8370-da58c978c569" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.368165] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36d222a7-3a24-40cd-8370-da58c978c569',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.401644] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.690177] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.690378] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.690378] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.690609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.690696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.690898] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.691034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.691117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.691280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.691358] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.691442] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af already deleted. [ 1111.691522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.870679] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.870965] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.871145] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.871477] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.871668] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.871862] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 36d222a7-3a24-40cd-8370-da58c978c569 not found, creating... [ 1111.872199] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.872401] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.872582] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.872837] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.873062] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.873367] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.873555] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.873681] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.873952] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.874126] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.874286] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 36d222a7-3a24-40cd-8370-da58c978c569 is going to be created. [ 1111.878843] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 in Status: SUCCESS [ 1111.879286] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.901149] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.901335] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.901584] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.901888] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.902231] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.902508] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-36d222a7-3a24-40cd-8370-da58c978c569" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.907654] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.907786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.907838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.908101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.908197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.908296] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e is going to be updated. [ 1111.942116] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.943437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.943437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.943437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.943437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.952827] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: IN_PROGRESS for 2s [ 1112.686735] env[70535]: INFO networking_nsxv3.common.synchronization [req-4bb0042b-6aee-4bb6-999f-e245eb7b025c req-55d3dae4-53a9-4876-ab6e-21f742110f52 service nova] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_rules [ 1112.687028] env[70535]: INFO networking_nsxv3.common.synchronization [req-4bb0042b-6aee-4bb6-999f-e245eb7b025c req-55d3dae4-53a9-4876-ab6e-21f742110f52 service nova] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1112.687525] env[70535]: INFO networking_nsxv3.common.synchronization [req-4bb0042b-6aee-4bb6-999f-e245eb7b025c req-55d3dae4-53a9-4876-ab6e-21f742110f52 service nova] Enqueued Resource ID: 36d222a7-3a24-40cd-8370-da58c978c569 with Priority: HIGHEST for action port [ 1112.687776] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_rules [ 1112.687995] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1112.690492] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36d222a7-3a24-40cd-8370-da58c978c569 with Priority: HIGHEST for action port [ 1112.690492] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.690492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.690492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.690492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.690492] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.692583] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.693643] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.693643] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.693643] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.693643] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.693643] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.693643] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.693643] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.694344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.698019] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.698019] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-36d222a7-3a24-40cd-8370-da58c978c569 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.698019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36d222a7-3a24-40cd-8370-da58c978c569" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.698019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36d222a7-3a24-40cd-8370-da58c978c569" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.698019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36d222a7-3a24-40cd-8370-da58c978c569" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.698019] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36d222a7-3a24-40cd-8370-da58c978c569',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.935036] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edae0da3-713a-4ce1-bb9b-f814f5976678 in Status: SUCCESS [ 1112.935372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.935617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.935914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.936101] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.198826] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.200981] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.201128] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.204470] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36d222a7-3a24-40cd-8370-da58c978c569 with status ACTIVE [ 1113.204671] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.204794] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.204860] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.205085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.205215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.205354] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.206043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.206043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.206043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.206043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.206043] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.206272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.206272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.206333] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.206381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.206490] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36d222a7-3a24-40cd-8370-da58c978c569 is going to be updated. [ 1113.233037] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.233269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.233334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.233983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.234679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.234679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36d222a7-3a24-40cd-8370-da58c978c569" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.438805] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.439164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.439164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.439461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.440656] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.440656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.440656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.440656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.440656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.440656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.440656] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.636158] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-952 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.636375] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-952" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.636505] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-952" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.636828] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-952" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.637107] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.637269] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.637389] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.637681] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.637837] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.638091] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1113.638216] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1113.638328] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1113.638438] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1113.638552] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1113.638695] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1113.638789] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1113.661211] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1113.661393] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1113.661535] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1113.661727] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-952" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.662062] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.662248] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.662374] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.662722] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.662851] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.701349] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.802385] env[70535]: INFO networking_nsxv3.common.synchronization [req-dc4995c1-ff24-475b-8bfa-cac5884131f9 req-1d214e16-e4f3-4867-b9ca-7e3c6b95d5ac tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_members [ 1113.802995] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGHEST for action security_group_members [ 1113.803460] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.803645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.803778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.804069] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.804279] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.804426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.804747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.804831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.805669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.805669] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.851910] env[70535]: INFO networking_nsxv3.common.synchronization [req-dc4995c1-ff24-475b-8bfa-cac5884131f9 req-1d214e16-e4f3-4867-b9ca-7e3c6b95d5ac tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: b39fab32-95ce-4df1-9e31-354b0d00d187 with Priority: HIGHEST for action port [ 1113.852832] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b39fab32-95ce-4df1-9e31-354b0d00d187 with Priority: HIGHEST for action port [ 1113.853256] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-b39fab32-95ce-4df1-9e31-354b0d00d187 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.853395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b39fab32-95ce-4df1-9e31-354b0d00d187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.853464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b39fab32-95ce-4df1-9e31-354b0d00d187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.853749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b39fab32-95ce-4df1-9e31-354b0d00d187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.853937] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b39fab32-95ce-4df1-9e31-354b0d00d187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.943596] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.943596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.943808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.943856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.944040] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.944148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.944213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.944362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.944450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.944538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.944685] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.944776] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.944836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.944978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.945129] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.945219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.945280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.945418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.945493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.945574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.945661] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.966179] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: SUCCESS [ 1113.966263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.966766] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.966984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.967186] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.967305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.967369] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.967518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.967599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.967691] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.169865] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.170101] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.170268] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.170801] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.170801] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.170951] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb not found, creating... [ 1114.171330] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.171540] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.171667] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.171906] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.172196] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.172542] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.172722] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.172842] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.173077] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.173224] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.173385] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb is going to be created. [ 1114.205154] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.205391] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.205521] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.205795] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.206070] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.206306] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.209054] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.209479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.209479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.209479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.209631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.209631] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be created. [ 1114.234948] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.235119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.235187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.235399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.235560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.245964] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: UNINITIALIZED for 2s [ 1114.307799] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.308109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.308226] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.308544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.308688] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.308985] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.309159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.309254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.309500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.309617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.309747] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 is going to be updated. [ 1114.350730] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.350945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.350997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.351259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.351408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.358169] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b39fab32-95ce-4df1-9e31-354b0d00d187 with status ACTIVE [ 1114.358507] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.358651] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.358748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.358979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.359094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.359297] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.359427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.359502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.359675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.359754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.359941] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.360077] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.360152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.360331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.360433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.360473] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b39fab32-95ce-4df1-9e31-354b0d00d187 is going to be updated. [ 1114.368820] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 in Status: IN_PROGRESS for 2s [ 1114.388186] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.388361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.388428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.388645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.388783] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.388970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b39fab32-95ce-4df1-9e31-354b0d00d187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.449622] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edae0da3-713a-4ce1-bb9b-f814f5976678: rpc.has_security_group_logging(os_id): False [ 1114.469731] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.492223] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.492367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.492438] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.492733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.492773] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.492980] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.493093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.493158] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.493722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.493722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.493722] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.493722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.493722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.493955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.493955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.494353] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.494353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.494353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.494482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.494482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.494561] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edae0da3-713a-4ce1-bb9b-f814f5976678 is going to be updated. [ 1114.588777] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.589106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.589268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.589612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.589857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.615109] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edae0da3-713a-4ce1-bb9b-f814f5976678 in Status: IN_PROGRESS for 2s [ 1114.799779] env[70535]: INFO networking_nsxv3.common.synchronization [req-5484db37-e46e-47fd-b4bc-f6162273d90c req-ba91e256-a3fb-4c4d-96b9-b3e1758461ca tempest-ListServerFiltersTestJSON-136218615 tempest-ListServerFiltersTestJSON-136218615-project-member] Enqueued Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1114.799779] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1114.799779] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.799779] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.954281] env[70535]: INFO networking_nsxv3.common.synchronization [req-4bb0042b-6aee-4bb6-999f-e245eb7b025c req-69a8d2d8-cbee-4ad1-b904-8e251e137a2f service nova] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_rules [ 1114.954281] env[70535]: INFO networking_nsxv3.common.synchronization [req-4bb0042b-6aee-4bb6-999f-e245eb7b025c req-69a8d2d8-cbee-4ad1-b904-8e251e137a2f service nova] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1114.959597] env[70535]: INFO networking_nsxv3.common.synchronization [req-4bb0042b-6aee-4bb6-999f-e245eb7b025c req-69a8d2d8-cbee-4ad1-b904-8e251e137a2f service nova] Enqueued Resource ID: 4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb with Priority: HIGHEST for action port [ 1114.959597] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_rules [ 1114.959597] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1114.959597] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb with Priority: HIGHEST for action port [ 1114.959597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.959597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.959597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.959597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.959597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.959597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.959597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.959597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.959597] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.972688] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.339778] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-944 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.339997] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-944" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.340315] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-944" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.340679] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-944" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.340964] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.341177] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.341316] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.341518] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.341666] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.341960] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.342659] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.342659] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.342659] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.342659] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.342659] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.342659] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.374342] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.374608] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1115.374828] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.375175] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-944" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.375675] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-620a5939-39b1-4e86-b8c1-f16c60e0ecc8 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.375979] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-620a5939-39b1-4e86-b8c1-f16c60e0ecc8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.376200] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-620a5939-39b1-4e86-b8c1-f16c60e0ecc8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.376703] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-620a5939-39b1-4e86-b8c1-f16c60e0ecc8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.376930] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('620a5939-39b1-4e86-b8c1-f16c60e0ecc8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.464466] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb with status ACTIVE [ 1115.464726] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.464857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.464857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.465134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.465228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.465489] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.465652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.465729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.465914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.466130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.466282] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.466374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.466453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.466631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.466717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.466803] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb is going to be updated. [ 1115.478438] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.478609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.478670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.478907] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.479087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.479221] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e is going to be updated. [ 1115.498895] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.499129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.499239] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.499389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.499531] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.499695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eb58a4d-aa3e-4dcd-a30b-a3a0fdde4ddb" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.516309] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.516997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.516997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.517141] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.517416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.531665] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: IN_PROGRESS for 2s [ 1115.821023] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-721 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.821023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-721" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.821023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-721" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.821023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-721" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.821023] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.821023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.821023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.821604] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.821895] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.822249] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.822493] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.822723] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.822951] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.823226] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.823564] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.823803] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.845182] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.845393] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1115.845539] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.845724] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-721" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.846072] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-7d688d3b-1a64-476a-bfc8-9e059b7af156 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.846281] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-7d688d3b-1a64-476a-bfc8-9e059b7af156" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.846383] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-7d688d3b-1a64-476a-bfc8-9e059b7af156" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.846723] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-7d688d3b-1a64-476a-bfc8-9e059b7af156" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.846867] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d688d3b-1a64-476a-bfc8-9e059b7af156',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.881962] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.882219] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.882352] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.882723] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.882909] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.884947] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 620a5939-39b1-4e86-b8c1-f16c60e0ecc8 not found, creating... [ 1115.884947] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.884947] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.884947] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.884947] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.884947] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.884947] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.884947] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.884947] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.884947] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.885655] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.886049] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 620a5939-39b1-4e86-b8c1-f16c60e0ecc8 is going to be created. [ 1115.909082] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.909339] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.909469] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.909751] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.909984] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.910283] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-620a5939-39b1-4e86-b8c1-f16c60e0ecc8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.256146] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1116.256447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.256646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.256906] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.260650] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.260650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.260650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.260650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.260650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.260650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.260650] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.260650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.260650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.260650] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.260650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.260650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.260650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.260650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.260650] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.349576] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.349859] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.350033] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.350350] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.350555] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.350782] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 7d688d3b-1a64-476a-bfc8-9e059b7af156 not found, creating... [ 1116.351114] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.351294] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.351417] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.351649] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.351796] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.352160] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.352368] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.352598] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.352865] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.353763] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.353763] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 7d688d3b-1a64-476a-bfc8-9e059b7af156 is going to be created. [ 1116.374722] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.374722] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.374902] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.375159] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.375579] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.375718] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-7d688d3b-1a64-476a-bfc8-9e059b7af156" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.379462] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 in Status: SUCCESS [ 1116.379628] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 deletion is rescheduled due to dependency. [ 1116.379736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.635114] env[70535]: INFO networking_nsxv3.common.synchronization [req-5484db37-e46e-47fd-b4bc-f6162273d90c req-e84d6bf1-203d-4d4d-8d02-dd6e0fed24ab service nova] Enqueued Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_rules [ 1116.635705] env[70535]: INFO networking_nsxv3.common.synchronization [req-5484db37-e46e-47fd-b4bc-f6162273d90c req-e84d6bf1-203d-4d4d-8d02-dd6e0fed24ab service nova] Enqueued Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1116.635705] env[70535]: INFO networking_nsxv3.common.synchronization [req-5484db37-e46e-47fd-b4bc-f6162273d90c req-e84d6bf1-203d-4d4d-8d02-dd6e0fed24ab service nova] Enqueued Resource ID: 620a5939-39b1-4e86-b8c1-f16c60e0ecc8 with Priority: HIGHEST for action port [ 1116.635705] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_rules [ 1116.635901] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1116.635901] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 620a5939-39b1-4e86-b8c1-f16c60e0ecc8 with Priority: HIGHEST for action port [ 1116.636568] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.636713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.637177] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.637351] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.637616] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-620a5939-39b1-4e86-b8c1-f16c60e0ecc8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.637793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-620a5939-39b1-4e86-b8c1-f16c60e0ecc8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.637898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-620a5939-39b1-4e86-b8c1-f16c60e0ecc8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.638422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-620a5939-39b1-4e86-b8c1-f16c60e0ecc8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.640031] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('620a5939-39b1-4e86-b8c1-f16c60e0ecc8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.642162] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edae0da3-713a-4ce1-bb9b-f814f5976678 in Status: SUCCESS [ 1116.642463] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.762307] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.762517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.764705] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.135071] env[70535]: INFO networking_nsxv3.common.synchronization [req-4bb0042b-6aee-4bb6-999f-e245eb7b025c req-87b16036-10e1-4c9c-aec2-c9f1fce3f08c service nova] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_rules [ 1117.135071] env[70535]: INFO networking_nsxv3.common.synchronization [req-4bb0042b-6aee-4bb6-999f-e245eb7b025c req-87b16036-10e1-4c9c-aec2-c9f1fce3f08c service nova] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1117.135071] env[70535]: INFO networking_nsxv3.common.synchronization [req-4bb0042b-6aee-4bb6-999f-e245eb7b025c req-87b16036-10e1-4c9c-aec2-c9f1fce3f08c service nova] Enqueued Resource ID: 7d688d3b-1a64-476a-bfc8-9e059b7af156 with Priority: HIGHEST for action port [ 1117.135071] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_rules [ 1117.135071] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1117.135071] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d688d3b-1a64-476a-bfc8-9e059b7af156 with Priority: HIGHEST for action port [ 1117.136039] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.142195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.142195] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.142195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.142195] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d688d3b-1a64-476a-bfc8-9e059b7af156 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.142195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d688d3b-1a64-476a-bfc8-9e059b7af156" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.142195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d688d3b-1a64-476a-bfc8-9e059b7af156" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.142195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d688d3b-1a64-476a-bfc8-9e059b7af156" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.142195] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d688d3b-1a64-476a-bfc8-9e059b7af156',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.144266] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 620a5939-39b1-4e86-b8c1-f16c60e0ecc8 with status ACTIVE [ 1117.145423] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.145423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.145423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.145423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.145423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.145423] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.145423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.145423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.145423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.146079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.146079] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.146079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.146079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.146079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.146079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.146079] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 620a5939-39b1-4e86-b8c1-f16c60e0ecc8 is going to be updated. [ 1117.181744] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.181924] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.181999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.182239] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.182414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.182584] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-620a5939-39b1-4e86-b8c1-f16c60e0ecc8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.214579] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-421 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.214794] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-421" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.214925] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-421" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.215245] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-421" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.215564] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.215751] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.215964] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.216421] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.216620] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.216852] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.216979] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.217113] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.217230] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.217347] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.217460] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.217636] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.248625] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.248875] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1117.249186] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.249449] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-421" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.249858] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-e8502457-3e1c-459a-9499-fa08683817a8 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.250109] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.250288] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.250639] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.250827] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8502457-3e1c-459a-9499-fa08683817a8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.266727] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.544149] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: SUCCESS [ 1117.544390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.544884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.545193] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.545417] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.545567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.545659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.545856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.545994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.546638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.546871] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.547011] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.547105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.547295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.547485] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.547612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.547694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.547848] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.547963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.548232] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.548350] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.549269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.549444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.549613] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.549822] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.549822] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.549927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.550037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.550157] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.642612] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d688d3b-1a64-476a-bfc8-9e059b7af156 with status ACTIVE [ 1117.642911] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.643116] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.643191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.643464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.643558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.643804] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.643949] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.644026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.644244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.644390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.644689] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.644754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.644845] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.645132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.645192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.645330] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d688d3b-1a64-476a-bfc8-9e059b7af156 is going to be updated. [ 1117.670137] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.670396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.670396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.670762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.671066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.671408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d688d3b-1a64-476a-bfc8-9e059b7af156" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.753646] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.753863] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.754050] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.754539] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.754739] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.755076] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.755298] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.755444] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.755693] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.755895] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.756208] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.756391] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.756514] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.756730] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.756883] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.757094] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: e8502457-3e1c-459a-9499-fa08683817a8 is going to be updated. [ 1117.769564] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.769784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.769784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.770019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.770123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.770223] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1117.787805] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.788502] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.788502] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.788816] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.788816] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.788957] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.802071] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.802319] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.802464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.802788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.803050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.823969] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1117.946974] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.947280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.947395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.948027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.948409] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.052458] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9880b7c6-6a3a-464f-abdc-889ae782e20e: rpc.has_security_group_logging(os_id): False [ 1118.054047] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.077422] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.077685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.077812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.078190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.078348] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.078688] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.078906] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.079051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.079317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.079465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.079782] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.079939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.080053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.080292] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.080423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.080722] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.080883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.080988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.081235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.081371] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.081513] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e is going to be created. [ 1118.155665] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.155990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.155990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.156214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.156801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.178619] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: IN_PROGRESS for 2s [ 1118.453526] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.506950] env[70535]: INFO networking_nsxv3.common.synchronization [req-6170c1de-98e1-4894-ba1a-5db778b0c0f4 req-c9954591-baed-4fb8-9d26-b92b26636bfe service nova] Enqueued Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_rules [ 1118.506950] env[70535]: INFO networking_nsxv3.common.synchronization [req-6170c1de-98e1-4894-ba1a-5db778b0c0f4 req-c9954591-baed-4fb8-9d26-b92b26636bfe service nova] Enqueued Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_members [ 1118.506950] env[70535]: INFO networking_nsxv3.common.synchronization [req-6170c1de-98e1-4894-ba1a-5db778b0c0f4 req-c9954591-baed-4fb8-9d26-b92b26636bfe service nova] Enqueued Resource ID: e8502457-3e1c-459a-9499-fa08683817a8 with Priority: HIGHEST for action port [ 1118.506950] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_rules [ 1118.506950] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_members [ 1118.506950] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8502457-3e1c-459a-9499-fa08683817a8 with Priority: HIGHEST for action port [ 1118.506950] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.507483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.507483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.507483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.507483] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.508665] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.508861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.509020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.509236] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.509432] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.509591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.510882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.510882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.510882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.510882] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.510882] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8502457-3e1c-459a-9499-fa08683817a8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.511076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.511076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.511214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.514176] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8502457-3e1c-459a-9499-fa08683817a8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.557791] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.958059] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.012773] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.012938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.013201] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.014296] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8502457-3e1c-459a-9499-fa08683817a8 with status ACTIVE [ 1119.014467] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.014638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.014638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.014859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.014908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.015093] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.015183] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.015267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.015415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.015497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.015687] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.015773] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.015834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.016074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.016193] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.016285] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8502457-3e1c-459a-9499-fa08683817a8 is going to be updated. [ 1119.043039] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.043265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.043265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.043445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.043682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.043924] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8502457-3e1c-459a-9499-fa08683817a8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.061069] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.061250] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.061349] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.061621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.061735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.061858] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e is going to be updated. [ 1119.100154] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.100350] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.100350] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.101033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.101033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.119714] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: IN_PROGRESS for 2s [ 1119.460268] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1119.460658] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1119.518419] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.835910] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1119.837223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.837410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.837670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.838129] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.838339] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.838433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.838691] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.838796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.839010] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.839299] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.839406] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.839477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.839666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.839825] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.839931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.839994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.840187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.840268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.840362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.840471] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.841349] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.841515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.841668] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.841776] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.841839] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.841983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.842106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.842166] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.022455] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.022655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.022720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.023092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.023139] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.023424] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 is going to be updated. [ 1120.062310] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.062467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.062600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.062822] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.063101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.075744] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: IN_PROGRESS for 2s [ 1120.199951] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: SUCCESS [ 1120.200326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.200586] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.200890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.201022] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.344406] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 461f32c9-3471-46f7-8f0a-362b6fb196af: rpc.has_security_group_logging(os_id): False [ 1120.345182] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.384514] env[70535]: INFO networking_nsxv3.common.synchronization [req-83d2172c-fe3b-4256-9f60-b577cf248a5c req-ddd6d100-b193-4cb1-b200-1d8acfc05563 tempest-ServersTestJSON-886254797 tempest-ServersTestJSON-886254797-project-member] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1120.385068] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1120.385381] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.385523] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.385591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.385857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.386049] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.386290] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.386290] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.386435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.386548] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.386655] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.388905] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.388905] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.389143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.389143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.389231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.389402] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.389529] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.389569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.389721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.389799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.389999] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.390118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.390180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.390322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.390395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.390592] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.390691] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.390775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.390937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.391038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.391167] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be created. [ 1120.394208] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.394344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.394411] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.394631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.406787] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1120.407794] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.410426] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1120.452549] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.456024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.456024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.456024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.465019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.466327] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1120.466619] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1120.466814] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1120.544249] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.544249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.544249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.544249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.545769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.546231] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1120.548792] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.549029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.549175] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.549470] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.549722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.568049] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1120.704859] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.704859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.725177] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.725177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.725177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.725177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.725177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.725177] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1120.851672] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.911657] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.911862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.912068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.913317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.913474] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.913790] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.913966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.914091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.914366] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.914501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.914646] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 already deleted. [ 1120.914789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.973399] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.973541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.973541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.973790] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.974129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.974484] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:51. [ 1120.974595] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0fe09099-3626-4cb3-9710-c5c35d48d103', 'd004720e-0079-4896-920b-7b1e57b6b7b8', 'c30db4ac-0243-4260-914e-2e6a0283c93a', '63056e22-45eb-4c1b-b65b-578fb5876c5b', '38f24a1f-1902-4055-9039-309e33c0499b', '9b11bca7-ad54-4a56-a651-3a19b70ab917', 'd167e03b-4e91-4b8f-9fa3-5a3c0b4222c2', '8f0ce39e-83c0-4345-91bb-9366dd77a60c', 'b05014f4-0d5c-444e-a37c-dbe58f585d75', '6b3e2660-4c57-4d95-a486-449e2bf37488', '90c4bd0b-6551-40c3-9e23-945c4ab91af0', 'f9244c40-b3c3-42a1-af4b-33b8585c25ed', '9880b7c6-6a3a-464f-abdc-889ae782e20e', '50631980-025e-4f7c-a21a-486351e09d1f', '46eec3ed-88a9-4ea1-a649-2f92efa91eb5', 'a61a906f-165f-4ddb-98ee-a6437a47d544', '00628945-9b3d-4cd6-939f-483e37c62dbe', 'bc5fb1bb-573b-4a41-9b95-86e55eedb265', '1cf5479f-0fc2-40f1-871d-b049fdff299b', '679d2a4f-8236-41e0-99ab-1f6326515c29', 'eda75f17-393d-4d95-8a9b-a7924138f446', '56df97d7-88f0-451d-89de-62650bdc9016', '81327d43-2c13-4e7b-b63b-d04a175b637e', 'edae0da3-713a-4ce1-bb9b-f814f5976678', '07ac4f9b-8f0d-49c2-916e-fc155db340ae', '52023f52-3978-48e2-8510-00221c047d2e', '76787551-efbb-4eb5-bef3-77685e9cde96', '461f32c9-3471-46f7-8f0a-362b6fb196af', '1f11229e-4f65-4aab-a492-ad9dd37f60f1', '7ebf2f9b-61f1-41ce-8d01-84394f8e9115', '1acbf3a7-2fe4-4e7f-abad-c1146da06d6b', 'f932dfa4-49e7-4477-968f-48bf223104fa', '59140a91-434d-4615-899a-f10ff35ce431', 'ec60a8db-faf5-42bd-94a8-662a5418627b', 'efe16881-900e-4f34-a1b9-20cdccf84a3f', 'acf72aac-3e82-4909-b3c4-dccd81be0846', '7b34086e-8eac-4499-9c02-2280b24b0698', 'ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878', '1e51be07-618c-4b2f-9bf9-d52bbd1658e6', 'c9eeea75-d1ec-4e08-9721-eccdc9dae25f', '704d6b72-3e14-4725-96b9-ddcf6d1bb8bc', '137ee755-5484-45a9-a8f1-2a50747a7208', '1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3', '597eb346-7afe-45b2-a812-9f2a8e62680f', 'c8d7fb02-d4e1-40c2-a711-afb7188e3a15', '4671052a-29bf-476d-9785-63d1baee1810', '48008d9c-bbf6-40a2-bb47-24eddd9f74c2', 'ec7c706b-a1b7-4402-b5c2-6e8302636c80', 'bbb53f03-8f48-4baa-b4e6-67243ad60187', 'cf801cfb-8004-42d6-a945-4d3f88953372', 'f32aa9cd-fe8f-4b69-8037-59fa1cf6570c'} {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1120.974757] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1121.004539] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.004774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.004851] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.005119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.005275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.005448] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1121.005552] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1121.005727] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1121.099151] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.099323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.099395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.099665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.100903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.102275] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1121.102275] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1121.102275] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1121.102275] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1121.102275] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/51 resources of Type:Security Group Rules [ 1121.102275] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGH for action security_group_rules [ 1121.102275] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGH for action security_group_rules [ 1121.102275] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGH for action security_group_rules [ 1121.102275] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGH for action security_group_rules [ 1121.102275] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 38f24a1f-1902-4055-9039-309e33c0499b with Priority: HIGH for action security_group_rules [ 1121.102275] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGH for action security_group_rules [ 1121.102275] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGH for action security_group_rules [ 1121.102275] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGH for action security_group_rules [ 1121.102275] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGH for action security_group_rules [ 1121.102275] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGH for action security_group_rules [ 1121.102275] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGH for action security_group_rules [ 1121.102275] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGH for action security_group_rules [ 1121.102275] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGH for action security_group_rules [ 1121.103281] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGH for action security_group_rules [ 1121.103281] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 with Priority: HIGH for action security_group_rules [ 1121.103281] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a61a906f-165f-4ddb-98ee-a6437a47d544 with Priority: HIGH for action security_group_rules [ 1121.103281] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGH for action security_group_rules [ 1121.103281] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 with Priority: HIGH for action security_group_rules [ 1121.103281] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b with Priority: HIGH for action security_group_rules [ 1121.103281] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 with Priority: HIGH for action security_group_rules [ 1121.103281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.127270] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.127500] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.127642] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.128076] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.128369] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.128540] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.128988] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.128988] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.132790] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.133137] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.133337] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1121.133386] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1121.133499] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1121.133614] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.133723] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1121.133863] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1121.135698] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: IN_PROGRESS for 4s [ 1121.155175] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1121.155366] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1121.155485] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1121.155708] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.156123] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-b9772d12-7120-4f6b-9cf9-7836904f34e4 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.156333] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-b9772d12-7120-4f6b-9cf9-7836904f34e4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.156478] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-b9772d12-7120-4f6b-9cf9-7836904f34e4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.156970] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-b9772d12-7120-4f6b-9cf9-7836904f34e4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.157131] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9772d12-7120-4f6b-9cf9-7836904f34e4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.353856] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.354053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.354116] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.354320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.354415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.354514] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1121.384108] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.384277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.384343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.384557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.384713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.395143] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1121.660714] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.661150] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.661649] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.661649] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.661873] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.662137] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port b9772d12-7120-4f6b-9cf9-7836904f34e4 not found, creating... [ 1121.662539] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.662831] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.663060] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.663317] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.663988] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.663988] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.664231] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.664432] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.664758] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.664977] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.665220] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: b9772d12-7120-4f6b-9cf9-7836904f34e4 is going to be created. [ 1121.694932] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.695270] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.695501] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.696307] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.696307] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.696307] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-b9772d12-7120-4f6b-9cf9-7836904f34e4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.088249] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: SUCCESS [ 1122.088487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.088663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.088886] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.089092] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.089242] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.089305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.089542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.089542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.089645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.089673] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.583030] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1122.583160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.583362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.583677] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.583781] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.592043] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.592189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.592189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.592444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.592659] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.592771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.593397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.593777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.593777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.593777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.594100] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.594100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.594199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.594453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.594453] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.594624] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.594624] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.594835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.594835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.595055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.595055] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.003034] env[70535]: INFO networking_nsxv3.common.synchronization [req-83d2172c-fe3b-4256-9f60-b577cf248a5c req-5df0e8a5-e723-4617-8cb3-c187d68e5e55 service nova] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_rules [ 1123.003297] env[70535]: INFO networking_nsxv3.common.synchronization [req-83d2172c-fe3b-4256-9f60-b577cf248a5c req-5df0e8a5-e723-4617-8cb3-c187d68e5e55 service nova] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1123.003458] env[70535]: INFO networking_nsxv3.common.synchronization [req-83d2172c-fe3b-4256-9f60-b577cf248a5c req-5df0e8a5-e723-4617-8cb3-c187d68e5e55 service nova] Enqueued Resource ID: b9772d12-7120-4f6b-9cf9-7836904f34e4 with Priority: HIGHEST for action port [ 1123.003734] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_rules [ 1123.003875] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1123.003978] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9772d12-7120-4f6b-9cf9-7836904f34e4 with Priority: HIGHEST for action port [ 1123.004094] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 with Priority: HIGH for action security_group_rules [ 1123.004191] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c30db4ac-0243-4260-914e-2e6a0283c93a with Priority: HIGH for action security_group_rules [ 1123.004287] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 with Priority: HIGH for action security_group_rules [ 1123.004379] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 with Priority: HIGH for action security_group_rules [ 1123.004999] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 with Priority: HIGH for action security_group_rules [ 1123.004999] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b with Priority: HIGH for action security_group_rules [ 1123.004999] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 with Priority: HIGH for action security_group_rules [ 1123.004999] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00628945-9b3d-4cd6-939f-483e37c62dbe with Priority: HIGH for action security_group_rules [ 1123.004999] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50631980-025e-4f7c-a21a-486351e09d1f with Priority: HIGH for action security_group_rules [ 1123.004999] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61a906f-165f-4ddb-98ee-a6437a47d544 with Priority: HIGH for action security_group_rules [ 1123.004999] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGH for action security_group_rules [ 1123.005382] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed with Priority: HIGH for action security_group_rules [ 1123.005382] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 with Priority: HIGH for action security_group_rules [ 1123.005382] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 with Priority: HIGH for action security_group_rules [ 1123.005382] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 with Priority: HIGH for action security_group_rules [ 1123.005382] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 with Priority: HIGH for action security_group_rules [ 1123.005562] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGH for action security_group_rules [ 1123.005562] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38f24a1f-1902-4055-9039-309e33c0499b with Priority: HIGH for action security_group_rules [ 1123.005646] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGH for action security_group_rules [ 1123.005683] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGH for action security_group_rules [ 1123.006671] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.007008] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.007095] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.007442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.007592] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.008668] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.008841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.008955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.009185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.010044] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.010044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.010044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.010044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.010044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.010044] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.011580] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9772d12-7120-4f6b-9cf9-7836904f34e4 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.011580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9772d12-7120-4f6b-9cf9-7836904f34e4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.011676] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9772d12-7120-4f6b-9cf9-7836904f34e4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.012043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9772d12-7120-4f6b-9cf9-7836904f34e4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.012043] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9772d12-7120-4f6b-9cf9-7836904f34e4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.012921] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fe09099-3626-4cb3-9710-c5c35d48d103 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.013115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.013215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.013548] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.013548] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fe09099-3626-4cb3-9710-c5c35d48d103',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.015590] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c30db4ac-0243-4260-914e-2e6a0283c93a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.015590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.015590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.015590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.015590] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c30db4ac-0243-4260-914e-2e6a0283c93a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.015590] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.015590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.015590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.016920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.016920] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.016920] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.016920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.016920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.016920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.016920] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46eec3ed-88a9-4ea1-a649-2f92efa91eb5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.018277] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-679d2a4f-8236-41e0-99ab-1f6326515c29 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.018277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.018277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.018277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.018277] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('679d2a4f-8236-41e0-99ab-1f6326515c29',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.019048] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cf5479f-0fc2-40f1-871d-b049fdff299b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.019048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.019048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.019281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.019281] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cf5479f-0fc2-40f1-871d-b049fdff299b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.020014] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.020137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.020200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.020391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.020471] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc5fb1bb-573b-4a41-9b95-86e55eedb265',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.021228] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00628945-9b3d-4cd6-939f-483e37c62dbe taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.021384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.021592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.021654] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.021738] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00628945-9b3d-4cd6-939f-483e37c62dbe',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.022561] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50631980-025e-4f7c-a21a-486351e09d1f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.022765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.022903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.023506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.023506] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50631980-025e-4f7c-a21a-486351e09d1f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.024427] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a61a906f-165f-4ddb-98ee-a6437a47d544 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.024628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.024714] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.024803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.024889] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a61a906f-165f-4ddb-98ee-a6437a47d544',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.025900] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.026050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.026287] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.026456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.026523] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.026715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.026853] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9244c40-b3c3-42a1-af4b-33b8585c25ed',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.029587] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.029587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.029587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.029840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.029840] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90c4bd0b-6551-40c3-9e23-945c4ab91af0',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.030737] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b3e2660-4c57-4d95-a486-449e2bf37488 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.030925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.030925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.031240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.031240] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b3e2660-4c57-4d95-a486-449e2bf37488',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.032541] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b05014f4-0d5c-444e-a37c-dbe58f585d75 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.032541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.032541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.032541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.032541] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b05014f4-0d5c-444e-a37c-dbe58f585d75',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.033305] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b11bca7-ad54-4a56-a651-3a19b70ab917 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.033429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.033472] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.033646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.033703] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b11bca7-ad54-4a56-a651-3a19b70ab917',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.034508] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.034700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.035100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.035100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.035100] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.036103] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38f24a1f-1902-4055-9039-309e33c0499b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.036258] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.036353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.036571] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.036663] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38f24a1f-1902-4055-9039-309e33c0499b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.037464] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.037576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.037642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.038016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.038016] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.039317] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.039420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.039818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.039818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.039818] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.077616] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.077888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.077888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.080518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.081609] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.081609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.082602] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.083175] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.085677] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.085854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.086149] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.087256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.097828] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878: rpc.has_security_group_logging(os_id): False [ 1123.102360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.102360] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc5fb1bb-573b-4a41-9b95-86e55eedb265 is going to be deleted. [ 1123.102568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.102705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.118070] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.118255] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.123824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.124081] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fe09099-3626-4cb3-9710-c5c35d48d103 is going to be deleted. [ 1123.125073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.125418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.145123] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: SUCCESS [ 1123.145360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.145541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.145792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.146122] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.146260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.146330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.146670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.146670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.146670] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.155017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.155186] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2 is going to be deleted. [ 1123.156377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.156619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.179805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.179997] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50631980-025e-4f7c-a21a-486351e09d1f is going to be deleted. [ 1123.181595] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.181871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.203496] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.203646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.205905] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.206178] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.222393] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.222393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.223616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.223876] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.224024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.224074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.224374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.224467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.224711] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.224840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.224874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.225111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.225283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.225490] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.225653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.225733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.225888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.225984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.226103] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 is going to be updated. [ 1123.227263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.227434] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.227523] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.227641] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fe09099-3626-4cb3-9710-c5c35d48d103" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.228181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.228342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.228425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.228540] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc5fb1bb-573b-4a41-9b95-86e55eedb265" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.228769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.228956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.229067] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.229210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d167e03b-4e91-4b8f-9fa3-5a3c0b4222c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.275510] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.275510] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.275784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.276302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.276302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.276302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50631980-025e-4f7c-a21a-486351e09d1f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.390628] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.390803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.390889] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.391073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.391241] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.406979] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1123.407297] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.407551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.407859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.408259] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.408498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.408498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.408675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.408783] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.408892] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.408993] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.413638] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: IN_PROGRESS for 2s [ 1123.546153] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.547177] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9772d12-7120-4f6b-9cf9-7836904f34e4 with status ACTIVE [ 1123.548524] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.548524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.548524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.548524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.548524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.548524] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.548524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.548524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.548937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.548937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.549011] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.549122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.549180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.549347] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.549664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.549664] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9772d12-7120-4f6b-9cf9-7836904f34e4 is going to be updated. [ 1123.552769] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.552894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.552962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.553176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.553337] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.553435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.553511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.553647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.553762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.553834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.553922] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.558291] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.558291] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.568966] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.573618] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.573809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.573850] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.574129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.574318] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.574424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.574503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.574668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.574771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.574865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.574954] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.578860] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.578860] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.578860] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.579080] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.582681] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f0ce39e-83c0-4345-91bb-9366dd77a60c: rpc.has_security_group_logging(os_id): False [ 1123.613236] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.613450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.617705] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.617895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.622634] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.622893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.627592] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.627819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.629350] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.629556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.629556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.630281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.630483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.630664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9772d12-7120-4f6b-9cf9-7836904f34e4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.636064] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.636268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.638429] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.638657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.639769] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.639905] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.640914] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.641032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.641873] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.641966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.642900] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1123.643630] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.643730] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.644448] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1123.645687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.645687] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00628945-9b3d-4cd6-939f-483e37c62dbe is going to be deleted. [ 1123.646924] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.647054] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.647097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.647361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.650886] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.651062] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.651762] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1123.652343] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.652437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.653209] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.679376] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1123.680127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.680434] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 679d2a4f-8236-41e0-99ab-1f6326515c29 is going to be deleted. [ 1123.681492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.681719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.709055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.709260] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b05014f4-0d5c-444e-a37c-dbe58f585d75 is going to be deleted. [ 1123.710612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.710893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.733456] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.734501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.751790] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.751790] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.760722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.760933] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46eec3ed-88a9-4ea1-a649-2f92efa91eb5 is going to be deleted. [ 1123.762279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.762591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.799306] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.799490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.805698] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.805870] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9244c40-b3c3-42a1-af4b-33b8585c25ed is going to be deleted. [ 1123.806881] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.807119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.859178] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.859337] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b11bca7-ad54-4a56-a651-3a19b70ab917 is going to be deleted. [ 1123.860231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.860458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.893117] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.893302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.913029] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.913029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.913029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.913029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.913029] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.913029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.913029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.913029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.913029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.913029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.913558] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.913558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.913558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.913558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.913558] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.913727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.913727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.913786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.913830] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.913903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.913986] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.939492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.939815] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.939919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.939985] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.940255] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.940353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.940453] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be updated. [ 1123.941903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.942812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.993048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.993218] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a61a906f-165f-4ddb-98ee-a6437a47d544 is going to be deleted. [ 1123.994639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.994639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.008203] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.008567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.055101] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.083240] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.091856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.091989] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c30db4ac-0243-4260-914e-2e6a0283c93a is going to be deleted. [ 1124.093011] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.093249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.099456] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.099640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.110323] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.110571] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.130535] env[70535]: INFO networking_nsxv3.common.synchronization [req-d1e7151c-4c3e-49ca-8d99-2d1826e83572 req-b02f4dd1-6b17-44d1-b7ef-da71aafd7c4f tempest-ServerDiskConfigTestJSON-1021082095 tempest-ServerDiskConfigTestJSON-1021082095-project-member] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 1124.131278] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 1124.131586] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.131711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.131777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.131977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.132363] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.132424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.132492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.132658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.132749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.132841] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.156068] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.166021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.166021] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b3e2660-4c57-4d95-a486-449e2bf37488 is going to be deleted. [ 1124.166021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.166021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.186995] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.187198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.246558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.246668] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90c4bd0b-6551-40c3-9e23-945c4ab91af0 is going to be deleted. [ 1124.247598] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.247819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.373086] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.373235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.373983] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.374099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.379932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.380068] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be deleted. [ 1124.380987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.381231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.417171] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 461f32c9-3471-46f7-8f0a-362b6fb196af: rpc.has_security_group_logging(os_id): False [ 1124.443849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.444016] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cf5479f-0fc2-40f1-871d-b049fdff299b is going to be deleted. [ 1124.445094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.445382] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.445631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.445846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00628945-9b3d-4cd6-939f-483e37c62dbe" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.446358] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.446624] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.446747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.446910] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-679d2a4f-8236-41e0-99ab-1f6326515c29" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.447721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.448171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.448344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.448423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b05014f4-0d5c-444e-a37c-dbe58f585d75" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.448569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.448729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.448807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.448922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46eec3ed-88a9-4ea1-a649-2f92efa91eb5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.449061] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.449267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.455380] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.455585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.487753] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.487938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.500811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.500991] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38f24a1f-1902-4055-9039-309e33c0499b is going to be deleted. [ 1124.501981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.502225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.502318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.502446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9244c40-b3c3-42a1-af4b-33b8585c25ed" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.502815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.502981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.503076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.503216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b11bca7-ad54-4a56-a651-3a19b70ab917" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.503724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.503889] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.504051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.505164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.505330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.505414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.505533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a61a906f-165f-4ddb-98ee-a6437a47d544" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.505675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.505822] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.505902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.506920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c30db4ac-0243-4260-914e-2e6a0283c93a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.507789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.507952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.508074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.508205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b3e2660-4c57-4d95-a486-449e2bf37488" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.508365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.508522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.508604] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.508826] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.508939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.509010] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.509187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.509300] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.509543] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.509649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.509711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.510254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.510379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.510592] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.510681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.510742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.510886] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.510962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.511058] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1124.512368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.512567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.512654] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.512774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90c4bd0b-6551-40c3-9e23-945c4ab91af0" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.556857] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.557035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.557083] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.557296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.557390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.557490] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be created. [ 1124.566417] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.566608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.566675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.566828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.566919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.567051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cf5479f-0fc2-40f1-871d-b049fdff299b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.573417] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.573652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.573652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.573804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.574220] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.574220] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.584711] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: IN_PROGRESS for 2s [ 1124.586967] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d004720e-0079-4896-920b-7b1e57b6b7b8: rpc.has_security_group_logging(os_id): False [ 1124.622898] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.623072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.623172] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.623419] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.636510] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.636731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.641297] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.641498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.641498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.641713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.642028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.658615] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.658828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.658828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.659243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.659456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.659595] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e is going to be updated. [ 1124.690629] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: UNINITIALIZED for 2s [ 1124.707786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.708387] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.708552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.708552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.712042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.712042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.712042] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 is going to be updated. [ 1124.712042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.712042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.735210] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.735367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.743558] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.743853] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.744024] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.744430] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.744896] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.745201] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.745440] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.745817] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.746130] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.746531] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.746748] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1124.746990] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1124.747245] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1124.747443] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.748011] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1124.748011] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1124.752955] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.753102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.771452] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.771738] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.771821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.772132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.772361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.779148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.779148] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.779275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.779317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.779658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.779805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.779982] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 1124.782041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.782307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.782690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.782690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38f24a1f-1902-4055-9039-309e33c0499b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.784182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.784182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.784182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.793596] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1124.793858] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1124.794021] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1124.794342] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-356" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.794892] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-872fb7c5-f72d-4cdb-ba23-8cb5c683d68c taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.795140] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-872fb7c5-f72d-4cdb-ba23-8cb5c683d68c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.795275] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-872fb7c5-f72d-4cdb-ba23-8cb5c683d68c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.795681] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-872fb7c5-f72d-4cdb-ba23-8cb5c683d68c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.795792] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('872fb7c5-f72d-4cdb-ba23-8cb5c683d68c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.819650] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: IN_PROGRESS for 2s [ 1124.854667] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1124.910757] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.910757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.910757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.910757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.910757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.921028] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.921028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.921028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.921028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.921028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.943212] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 1124.947992] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1124.947992] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: IN_PROGRESS for 2s [ 1125.298896] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.299294] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.299505] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.299858] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.300090] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.300427] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 872fb7c5-f72d-4cdb-ba23-8cb5c683d68c not found, creating... [ 1125.300830] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.301119] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.301267] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.301639] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.301885] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.305910] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.306685] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.306685] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.308971] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.308971] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.308971] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 872fb7c5-f72d-4cdb-ba23-8cb5c683d68c is going to be created. [ 1125.334416] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.334657] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.334804] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.335155] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.335452] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.335733] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-872fb7c5-f72d-4cdb-ba23-8cb5c683d68c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.433549] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: SUCCESS [ 1125.435138] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.124890] env[70535]: INFO networking_nsxv3.common.synchronization [req-d1e7151c-4c3e-49ca-8d99-2d1826e83572 req-e151b530-23fd-4eee-8557-1c9ca30684c3 service nova] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_rules [ 1126.125148] env[70535]: INFO networking_nsxv3.common.synchronization [req-d1e7151c-4c3e-49ca-8d99-2d1826e83572 req-e151b530-23fd-4eee-8557-1c9ca30684c3 service nova] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 1126.125338] env[70535]: INFO networking_nsxv3.common.synchronization [req-d1e7151c-4c3e-49ca-8d99-2d1826e83572 req-e151b530-23fd-4eee-8557-1c9ca30684c3 service nova] Enqueued Resource ID: 872fb7c5-f72d-4cdb-ba23-8cb5c683d68c with Priority: HIGHEST for action port [ 1126.126050] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_rules [ 1126.128296] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 1126.128428] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 872fb7c5-f72d-4cdb-ba23-8cb5c683d68c with Priority: HIGHEST for action port [ 1126.129675] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.129803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.129876] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.130185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.130268] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.131263] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.131362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.132026] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-872fb7c5-f72d-4cdb-ba23-8cb5c683d68c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.132026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-872fb7c5-f72d-4cdb-ba23-8cb5c683d68c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.132026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-872fb7c5-f72d-4cdb-ba23-8cb5c683d68c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.132026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-872fb7c5-f72d-4cdb-ba23-8cb5c683d68c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.132301] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('872fb7c5-f72d-4cdb-ba23-8cb5c683d68c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.602824] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 1126.602824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.633619] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.633767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.633986] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 872fb7c5-f72d-4cdb-ba23-8cb5c683d68c with status ACTIVE [ 1126.634187] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.634312] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.634381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.634600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.634690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.634893] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.635016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.635087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.635339] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.635417] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.635606] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.635702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.635771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.635963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.636064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.636157] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 872fb7c5-f72d-4cdb-ba23-8cb5c683d68c is going to be updated. [ 1126.658165] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.658343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.658415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.658726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.658928] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.659328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-872fb7c5-f72d-4cdb-ba23-8cb5c683d68c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.702341] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1126.702675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.702951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.703299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.703612] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.703833] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.703902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.704183] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.704517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.704725] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.705441] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.830546] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: SUCCESS [ 1126.830796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.830931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.831204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.831666] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.831814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.831854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.832028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.832116] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.832204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.832295] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.869186] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1126.869424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.869611] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.869854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.869967] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.955538] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 1126.955714] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 deletion is rescheduled due to dependency. [ 1126.956129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.956129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.956260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.956393] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.957293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.957293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.957293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.957293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.957293] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.965125] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: SUCCESS [ 1126.965316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.209279] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.209866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.210237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.211506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.211703] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.211832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.211896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.212097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.212208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.212312] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.212534] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.212638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.212701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.212884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.213042] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.213152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.213211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.213325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.213397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.213476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.213561] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.337338] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.337523] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.337634] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.337978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.338366] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.338682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.338682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.338824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.338930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.339076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.339291] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.339381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.339441] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.339643] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.339881] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.340289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.341293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.341564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.341713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.342613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.342759] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.373029] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.373219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.373296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.373566] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.374555] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.374555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.374555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.374555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.374555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.375242] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.375300] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.461466] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.716392] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3608197f-2b1a-43a5-a7dc-0f91c90db3f1: rpc.has_security_group_logging(os_id): False [ 1127.737932] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.738333] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.738415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.738647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.738821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.740303] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.740465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.740556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.740759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.740849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.742015] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.742164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.742221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.742596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.742596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.742736] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.742875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.742875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.743212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.743212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.743212] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be created. [ 1127.814965] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.814965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.815224] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.815354] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.815601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.831051] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1127.848461] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9880b7c6-6a3a-464f-abdc-889ae782e20e: rpc.has_security_group_logging(os_id): False [ 1127.872823] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.873126] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.873232] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.873470] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.878604] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.878759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.878829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.879213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.879434] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.879591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.879636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.879993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.879993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.880094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.880207] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.880303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.880401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.880612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.880791] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.880885] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.880943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.881151] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.881306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.881439] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.881548] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.905370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.905370] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.905370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.905667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.905667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.905740] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.905933] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.906047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.906117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.906279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.906361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.907311] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.907428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.907498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.907666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.907751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.907845] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e is going to be updated. [ 1127.967306] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.006826] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.007127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.007207] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.007525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.007676] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.028553] env[70535]: INFO networking_nsxv3.common.synchronization [req-84319b34-b1a1-4da1-bcc3-2d2905841f79 req-6ceb01f6-b7ed-4968-b533-c8501a3d254f tempest-DeleteServersTestJSON-660883378 tempest-DeleteServersTestJSON-660883378-project-member] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1128.030982] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: IN_PROGRESS for 2s [ 1128.031343] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1128.031872] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.032814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.032971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.033576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.033980] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.034762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.034762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.034762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.035029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.035266] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.384622] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 461f32c9-3471-46f7-8f0a-362b6fb196af: rpc.has_security_group_logging(os_id): False [ 1128.407315] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.407482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.407554] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.407786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.407892] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.408207] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.408511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.408511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.408577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.408705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.408891] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.409117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.409179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.409384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.409423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.409603] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.409697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.409770] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.409916] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.409990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.410096] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1128.473806] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.473948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.474069] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.474352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.474473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.474579] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 1128.498542] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.498542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.498542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.498542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.498542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.522038] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1128.526051] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.526212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.526266] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.526594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.526854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.537898] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.538166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.538246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.538580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.544334] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 1128.581823] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.582168] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.582401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.582401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.582624] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.582688] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.582819] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1128.622930] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.623417] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.623629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.624053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.624313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.656519] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1128.661910] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.662256] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.662461] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.662812] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.664898] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.664898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.664898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.664898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.664898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.664898] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1128.664898] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1128.664898] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1128.664898] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1128.664898] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1128.664898] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1128.665703] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1128.694944] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1128.695168] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1128.695269] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1128.696016] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.696016] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-3aa77909-854f-4c98-aea3-552c6caa5e6c taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.696016] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-3aa77909-854f-4c98-aea3-552c6caa5e6c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.696337] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-3aa77909-854f-4c98-aea3-552c6caa5e6c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.696528] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-3aa77909-854f-4c98-aea3-552c6caa5e6c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.696679] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3aa77909-854f-4c98-aea3-552c6caa5e6c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.203389] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.204034] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.204034] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.204264] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.204454] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.204641] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 3aa77909-854f-4c98-aea3-552c6caa5e6c not found, creating... [ 1129.204989] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.205178] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.205299] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.205564] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.205730] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.210851] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.210851] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.211119] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.211609] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.211609] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.212915] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 3aa77909-854f-4c98-aea3-552c6caa5e6c is going to be created. [ 1129.249560] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.249860] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.249907] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.250262] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.250526] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.250787] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-3aa77909-854f-4c98-aea3-552c6caa5e6c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.844835] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1129.845520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.055235] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: SUCCESS [ 1130.057061] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.057061] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.057061] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.057061] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.167502] env[70535]: INFO networking_nsxv3.common.synchronization [req-84319b34-b1a1-4da1-bcc3-2d2905841f79 req-71f6a3dc-3c59-45c4-a492-0c99cbafab80 service nova] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_rules [ 1130.167665] env[70535]: INFO networking_nsxv3.common.synchronization [req-84319b34-b1a1-4da1-bcc3-2d2905841f79 req-71f6a3dc-3c59-45c4-a492-0c99cbafab80 service nova] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1130.167816] env[70535]: INFO networking_nsxv3.common.synchronization [req-84319b34-b1a1-4da1-bcc3-2d2905841f79 req-71f6a3dc-3c59-45c4-a492-0c99cbafab80 service nova] Enqueued Resource ID: 3aa77909-854f-4c98-aea3-552c6caa5e6c with Priority: HIGHEST for action port [ 1130.168486] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_rules [ 1130.168747] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1130.168868] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aa77909-854f-4c98-aea3-552c6caa5e6c with Priority: HIGHEST for action port [ 1130.169623] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.169744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.169858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.170100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.170192] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.171780] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.171887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.172134] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-3aa77909-854f-4c98-aea3-552c6caa5e6c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.172255] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3aa77909-854f-4c98-aea3-552c6caa5e6c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.173422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3aa77909-854f-4c98-aea3-552c6caa5e6c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.173634] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3aa77909-854f-4c98-aea3-552c6caa5e6c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.173723] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3aa77909-854f-4c98-aea3-552c6caa5e6c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.538973] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1130.539286] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.556313] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 1130.556313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.556313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.556313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.556313] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.556313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.556313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.556671] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.556671] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.556671] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.556797] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.558651] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.558784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.558830] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.559019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.559179] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.559388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.559388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.559479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.559562] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.559640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.559723] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.667292] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1130.667491] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f deletion is rescheduled due to dependency. [ 1130.667634] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.667835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.668078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.668297] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.668429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.668485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.668631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.668704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.668821] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.677186] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3aa77909-854f-4c98-aea3-552c6caa5e6c with status ACTIVE [ 1130.677412] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.677584] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.677650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.677848] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.677935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.678147] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.678262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.678324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.678468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.678535] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.678716] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.678809] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.678873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.679047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.679130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.679174] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3aa77909-854f-4c98-aea3-552c6caa5e6c is going to be updated. [ 1130.680643] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.680736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.702743] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.703035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.703418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.703418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.703519] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.703771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3aa77909-854f-4c98-aea3-552c6caa5e6c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.015897] env[70535]: INFO networking_nsxv3.common.synchronization [None req-a9d2312f-5517-423c-a51c-13e56535f1f5 tempest-MigrationsAdminTest-1671970304 tempest-MigrationsAdminTest-1671970304-project-member] Enqueued Resource ID: 3d8e0bf9-0540-472f-aca1-ae50ffd65ab2 with Priority: HIGHEST for action security_group_rules [ 1131.016914] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8e0bf9-0540-472f-aca1-ae50ffd65ab2 with Priority: HIGHEST for action security_group_rules [ 1131.017343] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8e0bf9-0540-472f-aca1-ae50ffd65ab2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.017506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8e0bf9-0540-472f-aca1-ae50ffd65ab2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.017586] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8e0bf9-0540-472f-aca1-ae50ffd65ab2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.017949] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8e0bf9-0540-472f-aca1-ae50ffd65ab2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.018045] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8e0bf9-0540-472f-aca1-ae50ffd65ab2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.059277] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.059516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.059516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.060399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.060399] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.060399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.060399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.060399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.060399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.060704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.060704] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.060843] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.060843] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.061132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.061132] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.061272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.061272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.061393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.061481] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.061562] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.061653] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.063334] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.063464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.063514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.063769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.064087] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.064183] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.064248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.064394] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.064475] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.064556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.064699] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.064784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.064842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.065173] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.065173] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.065295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.065331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.065989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.065989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.065989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.065989] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.171658] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.231664] env[70535]: INFO networking_nsxv3.common.synchronization [None req-a279c069-8a8f-4ac2-b750-d2c6640f5647 tempest-MigrationsAdminTest-1671970304 tempest-MigrationsAdminTest-1671970304-project-member] Enqueued Resource ID: 3d8e0bf9-0540-472f-aca1-ae50ffd65ab2 with Priority: HIGHEST for action security_group_rules [ 1131.232314] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8e0bf9-0540-472f-aca1-ae50ffd65ab2 with Priority: HIGHEST for action security_group_rules [ 1131.232706] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d8e0bf9-0540-472f-aca1-ae50ffd65ab2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.232825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d8e0bf9-0540-472f-aca1-ae50ffd65ab2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.544450] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.545290] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.545391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.545602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.545704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.545805] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8e0bf9-0540-472f-aca1-ae50ffd65ab2 already deleted. [ 1131.545893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8e0bf9-0540-472f-aca1-ae50ffd65ab2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.546208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d8e0bf9-0540-472f-aca1-ae50ffd65ab2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.546410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d8e0bf9-0540-472f-aca1-ae50ffd65ab2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.546500] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d8e0bf9-0540-472f-aca1-ae50ffd65ab2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.569453] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for acf72aac-3e82-4909-b3c4-dccd81be0846: rpc.has_security_group_logging(os_id): False [ 1131.570027] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9880b7c6-6a3a-464f-abdc-889ae782e20e: rpc.has_security_group_logging(os_id): False [ 1131.595113] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.595701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.595701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.595994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.596230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.596781] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.596781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.597409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.597409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.597409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.598420] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.598420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.598420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.602024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.602024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.602024] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.602024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.602024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.602024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.602024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.602024] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e is going to be updated. [ 1131.602024] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.602961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.603210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.603534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.606065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.606065] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.606065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.606065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.606065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.606217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.606361] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.606465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.606616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.606681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.606747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.607089] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.607089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.607089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.607254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.607321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.607402] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 1131.674331] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.683177] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.683395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.683395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.683660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.683815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.687030] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.687162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.687201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.688645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.688831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.710451] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: IN_PROGRESS for 2s [ 1131.711523] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 1132.076546] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.076745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.076783] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.077016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.077147] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.077268] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d8e0bf9-0540-472f-aca1-ae50ffd65ab2 already deleted. [ 1132.077354] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d8e0bf9-0540-472f-aca1-ae50ffd65ab2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.177991] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.177991] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.177991] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.177991] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.177991] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.177991] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1132.227338] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.227544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.227544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.227710] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.227853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.242869] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1133.731412] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: SUCCESS [ 1133.732065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.732065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.732285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.732438] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.734352] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 1133.734541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.239025] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.239025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.239025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.239025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.239025] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.239025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.239025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.239025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.239025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.239526] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.239526] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.254649] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1134.254838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.255340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.255568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.255758] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.255876] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.255940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.256170] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.256307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.256403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.256497] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.741426] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.742102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.742102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.742102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.742102] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.742310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.742310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.745204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.745204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.745204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.745204] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.745204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.745204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.745204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.745204] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.745204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.745204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.745204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.745204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.745204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.745204] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.759342] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.759623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.759709] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.759936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.760135] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.760235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.760297] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.760508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.760668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.760792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.761042] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.761226] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.761324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.761589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.761779] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.761903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.761966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.762181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.762310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.762450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.762576] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.960458] env[70535]: INFO networking_nsxv3.common.synchronization [req-f777ca38-fbc2-4a94-8152-b861137d4dfa req-24e965ff-37fc-45cf-81ab-e35e353e3795 tempest-ServersTestMultiNic-1028446262 tempest-ServersTestMultiNic-1028446262-project-member] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1134.960458] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1134.960458] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.960458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.960458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.960458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.960458] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.960458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.960458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.960458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.961046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.961294] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.247171] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9880b7c6-6a3a-464f-abdc-889ae782e20e: rpc.has_security_group_logging(os_id): False [ 1135.265269] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9eeea75-d1ec-4e08-9721-eccdc9dae25f: rpc.has_security_group_logging(os_id): False [ 1135.282122] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.282459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.282459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.282664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.282766] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.282978] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.285239] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.285440] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.285679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.285775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.286071] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.286244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.286318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.286552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.286637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.286883] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.286989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.287068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.287249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.287336] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.287433] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e is going to be updated. [ 1135.291872] env[70535]: INFO networking_nsxv3.common.synchronization [req-f777ca38-fbc2-4a94-8152-b861137d4dfa req-63087871-429a-4671-b861-d2b03ab5cd69 tempest-ServersTestMultiNic-1028446262 tempest-ServersTestMultiNic-1028446262-project-member] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1135.292549] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1135.293507] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.293596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.302367] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.302563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.302643] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.302940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.303056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.303258] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.303361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.303440] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.303597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.303707] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.303944] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.304259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.307582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.308018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.308126] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.308504] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.308629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.308672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.308888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.308962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.309240] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1135.345181] env[70535]: INFO networking_nsxv3.common.synchronization [req-7e80b0ce-94dd-4ff3-9e9c-1ee89ce1715c req-958cc8c9-159d-4e08-8ca3-77ffaa39d031 tempest-ServerRescueTestJSON-1736721769 tempest-ServerRescueTestJSON-1736721769-project-member] Enqueued Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_members [ 1135.346071] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_members [ 1135.346914] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.347171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.347265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.347619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.347873] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.348126] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.348126] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.348433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.348596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.348729] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.463385] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.473715] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.474561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.474561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.475267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.475591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.481731] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.481731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.481731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.482119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.482426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.561515] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: IN_PROGRESS for 2s [ 1135.565814] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1135.721119] env[70535]: INFO networking_nsxv3.common.synchronization [req-f777ca38-fbc2-4a94-8152-b861137d4dfa req-3592e459-15d8-44d9-9fe3-5dce5b817b8d tempest-ServersTestMultiNic-1028446262 tempest-ServersTestMultiNic-1028446262-project-member] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1135.722286] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1135.722793] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.722932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.854034] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.854417] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.854562] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.855092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.855202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.855529] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.855743] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.855743] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.855967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.856100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.856252] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e already deleted. [ 1135.856393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.875930] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-764 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.875930] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-764" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.875930] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-764" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.876311] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-764" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.876595] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.876766] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.876930] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.877252] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.877415] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.877640] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.877783] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.878015] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.878157] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.878356] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.878490] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.878636] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.904869] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.905996] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1135.908099] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.908099] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-764" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.908099] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-92dd50f9-487c-4023-9d40-3a8e46c6716d taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.908099] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-92dd50f9-487c-4023-9d40-3a8e46c6716d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.908099] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-92dd50f9-487c-4023-9d40-3a8e46c6716d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.908099] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-92dd50f9-487c-4023-9d40-3a8e46c6716d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.909141] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92dd50f9-487c-4023-9d40-3a8e46c6716d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.965947] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.412900] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.415500] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.415500] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.415500] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.415500] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.415500] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 92dd50f9-487c-4023-9d40-3a8e46c6716d not found, creating... [ 1136.415500] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.415500] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.415500] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.415500] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.415796] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.418962] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.418962] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.418962] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.420583] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.420874] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.421164] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 92dd50f9-487c-4023-9d40-3a8e46c6716d is going to be created. [ 1136.444275] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.444463] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.444646] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.444898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.445225] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.445561] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-92dd50f9-487c-4023-9d40-3a8e46c6716d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.473085] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.473085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.473085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.473085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.473085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.473085] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1136.527522] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.527522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.527638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.527796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.527989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.556267] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1137.333362] env[70535]: INFO networking_nsxv3.common.synchronization [req-7e80b0ce-94dd-4ff3-9e9c-1ee89ce1715c req-7dfcb6fa-8f13-41f9-b9fd-c3c68743750b service nova] Enqueued Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_rules [ 1137.333679] env[70535]: INFO networking_nsxv3.common.synchronization [req-7e80b0ce-94dd-4ff3-9e9c-1ee89ce1715c req-7dfcb6fa-8f13-41f9-b9fd-c3c68743750b service nova] Enqueued Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_members [ 1137.333775] env[70535]: INFO networking_nsxv3.common.synchronization [req-7e80b0ce-94dd-4ff3-9e9c-1ee89ce1715c req-7dfcb6fa-8f13-41f9-b9fd-c3c68743750b service nova] Enqueued Resource ID: 92dd50f9-487c-4023-9d40-3a8e46c6716d with Priority: HIGHEST for action port [ 1137.334015] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_rules [ 1137.334158] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_members [ 1137.334253] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92dd50f9-487c-4023-9d40-3a8e46c6716d with Priority: HIGHEST for action port [ 1137.334851] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.334998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.338657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.338657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.338657] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.339954] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.340092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.340164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.340733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.340733] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.340733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.340733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.340894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.340960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.341068] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.342033] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-92dd50f9-487c-4023-9d40-3a8e46c6716d taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.342355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92dd50f9-487c-4023-9d40-3a8e46c6716d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.342355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92dd50f9-487c-4023-9d40-3a8e46c6716d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.342555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92dd50f9-487c-4023-9d40-3a8e46c6716d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.342555] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92dd50f9-487c-4023-9d40-3a8e46c6716d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.575892] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: SUCCESS [ 1137.576128] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.579767] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1137.580016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.845544] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.845746] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.847157] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.851317] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92dd50f9-487c-4023-9d40-3a8e46c6716d with status ACTIVE [ 1137.851317] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.852476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.852476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.852476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.852476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.852476] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.852698] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.852698] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.852775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.852852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.853043] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.853136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.853195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.853339] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.853410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.853492] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92dd50f9-487c-4023-9d40-3a8e46c6716d is going to be updated. [ 1137.878666] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.878666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.878937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.879071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.879299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.879666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92dd50f9-487c-4023-9d40-3a8e46c6716d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.350152] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.567072] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1138.567072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.567072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.568199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.568199] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.568199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.568199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.568199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.568199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.568199] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.837719] env[70535]: INFO networking_nsxv3.common.synchronization [req-eb9a6c73-8e1b-4a1a-ae50-42aefe6cea53 req-35cabd31-c617-4ed5-813f-c95405f08d0e tempest-ServersAdminNegativeTestJSON-1138087894 tempest-ServersAdminNegativeTestJSON-1138087894-project-member] Enqueued Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_members [ 1138.838689] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_members [ 1138.840128] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.840357] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.840432] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.843887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.843887] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.843887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.843887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.843887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.843887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.843887] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.852385] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.852516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.852585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.852786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.852871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.852968] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e is going to be created. [ 1138.881015] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.881015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.881015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.881015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.881015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.890581] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e in Status: UNINITIALIZED for 2s [ 1139.071517] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.071517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.071517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.072177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.072177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.072177] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.072177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.072177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.072408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.072408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.072485] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1139.105031] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.105031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.105031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.105031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.105031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.115167] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1139.335835] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.336054] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.336160] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.336487] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.336813] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.337070] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.337255] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.337565] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.337775] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.338054] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.338237] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.338446] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.338638] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.338807] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.338966] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.339170] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.343486] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.367291] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.367291] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1139.367291] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.367730] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.367832] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-736104e5-a189-4796-a0cc-34b8fd17f47a taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.368085] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-736104e5-a189-4796-a0cc-34b8fd17f47a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.368149] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-736104e5-a189-4796-a0cc-34b8fd17f47a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.368602] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-736104e5-a189-4796-a0cc-34b8fd17f47a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.368741] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('736104e5-a189-4796-a0cc-34b8fd17f47a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.845419] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.871591] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.871837] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.872033] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.872395] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.872577] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.872753] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 736104e5-a189-4796-a0cc-34b8fd17f47a not found, creating... [ 1139.873111] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.873402] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.873727] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.874764] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.875032] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.875298] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.875530] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.875704] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.876059] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.876347] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.876541] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 736104e5-a189-4796-a0cc-34b8fd17f47a is going to be created. [ 1139.901961] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.902214] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.902328] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.902616] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.902854] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.903115] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-736104e5-a189-4796-a0cc-34b8fd17f47a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.347680] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.347860] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.347981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.348226] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.348358] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.348494] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efe16881-900e-4f34-a1b9-20cdccf84a3f is going to be updated. [ 1140.387114] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.387114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.387114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.387980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.387980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.403669] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efe16881-900e-4f34-a1b9-20cdccf84a3f in Status: IN_PROGRESS for 2s [ 1140.790252] env[70535]: INFO networking_nsxv3.common.synchronization [req-eb9a6c73-8e1b-4a1a-ae50-42aefe6cea53 req-7d985ca5-bb6f-468a-a227-d7823c9ea97d service nova] Enqueued Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_rules [ 1140.790252] env[70535]: INFO networking_nsxv3.common.synchronization [req-eb9a6c73-8e1b-4a1a-ae50-42aefe6cea53 req-7d985ca5-bb6f-468a-a227-d7823c9ea97d service nova] Enqueued Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_members [ 1140.790252] env[70535]: INFO networking_nsxv3.common.synchronization [req-eb9a6c73-8e1b-4a1a-ae50-42aefe6cea53 req-7d985ca5-bb6f-468a-a227-d7823c9ea97d service nova] Enqueued Resource ID: 736104e5-a189-4796-a0cc-34b8fd17f47a with Priority: HIGHEST for action port [ 1140.791167] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_rules [ 1140.791509] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_members [ 1140.791700] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 736104e5-a189-4796-a0cc-34b8fd17f47a with Priority: HIGHEST for action port [ 1140.792091] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.792371] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.792527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.792862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.793167] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.794367] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.794580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.794953] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-736104e5-a189-4796-a0cc-34b8fd17f47a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.795251] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-736104e5-a189-4796-a0cc-34b8fd17f47a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.795457] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-736104e5-a189-4796-a0cc-34b8fd17f47a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.800762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-736104e5-a189-4796-a0cc-34b8fd17f47a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.800762] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('736104e5-a189-4796-a0cc-34b8fd17f47a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.902209] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e in Status: SUCCESS [ 1140.902492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.903109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.903350] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.903589] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.903742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.903827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.903993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.904121] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.904218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.904401] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.038942] env[70535]: INFO networking_nsxv3.common.synchronization [req-344cc6cc-6d10-46b3-9b59-a0d19f9e621a req-63c8ab44-cf6e-4525-8cf0-4a7ef947018a tempest-ServerDiskConfigTestJSON-1021082095 tempest-ServerDiskConfigTestJSON-1021082095-project-member] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 1141.039131] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGHEST for action security_group_members [ 1141.039938] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.039938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.040487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.042019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.042019] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.042019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.042019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.042019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.042019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.042019] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.129192] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 4s [ 1141.301717] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.301841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.302345] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 736104e5-a189-4796-a0cc-34b8fd17f47a with status ACTIVE [ 1141.302345] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.302345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.302531] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.303821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.303821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.303821] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.303821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.303821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.303821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.303821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.304105] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.304105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.304171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.304787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.304787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.304787] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 736104e5-a189-4796-a0cc-34b8fd17f47a is going to be updated. [ 1141.327287] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.327467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.327549] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.327763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.327905] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.328080] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-736104e5-a189-4796-a0cc-34b8fd17f47a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.407981] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.408367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.408413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.408632] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.408835] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.408951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.409029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.409196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.409389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.409496] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.409651] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.409759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.409835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.409993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.410196] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.410305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.410370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.410514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.410594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.410679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.410769] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.544086] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.544086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.544485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.544485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.544485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.544730] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.544977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.545080] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.545252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.545943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.545943] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be updated. [ 1141.579672] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.579672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.579852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.580067] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.580223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.590155] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: IN_PROGRESS for 2s [ 1141.913999] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1cf765d-0bda-40d5-92f0-076a8eeca55e: rpc.has_security_group_logging(os_id): False [ 1141.933653] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.933827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.933864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.934098] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.934199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.934395] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.934498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.934561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.934752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.934847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.935116] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.935261] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.935314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.935483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.935566] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.935798] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.935921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.935987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.936149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.936923] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.936923] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e is going to be created. [ 1142.038166] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.038166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.038166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.038166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.038166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.051548] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e in Status: IN_PROGRESS for 2s [ 1142.417304] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efe16881-900e-4f34-a1b9-20cdccf84a3f in Status: SUCCESS [ 1142.417658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.417658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.418684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.418684] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.418684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.418684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.418684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.418684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.418684] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.921319] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.143406] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1143.143709] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af deletion is rescheduled due to dependency. [ 1143.143978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.144192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.144538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.144844] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.145080] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.145246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.145537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.145699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.145882] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.424576] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.604609] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acf72aac-3e82-4909-b3c4-dccd81be0846 in Status: SUCCESS [ 1143.604699] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 deletion is rescheduled due to dependency. [ 1143.604854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.648951] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.649180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.649180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.649475] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.649594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.649767] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.649864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.649920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.650096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.650171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.650257] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1143.684755] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.684921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.684985] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.685196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.685339] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.696344] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1143.930848] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.931044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.931123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.931618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.931618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.931721] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efe16881-900e-4f34-a1b9-20cdccf84a3f is going to be updated. [ 1143.965722] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.965926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.965997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.966205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.966441] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.981441] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efe16881-900e-4f34-a1b9-20cdccf84a3f in Status: IN_PROGRESS for 2s [ 1144.077287] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e in Status: SUCCESS [ 1144.078502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.234130] env[70535]: INFO networking_nsxv3.common.synchronization [req-185aa477-1685-4be7-9d5d-d99dedbef15f req-4bcaa2a0-ca32-4186-a906-fb2f050905ed tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_members [ 1144.234688] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_members [ 1144.234997] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f11229e-4f65-4aab-a492-ad9dd37f60f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.239268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.239409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.239572] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.239762] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.239868] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.239932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.240102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.240194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.240292] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.266249] env[70535]: INFO networking_nsxv3.common.synchronization [req-f259bb35-c648-4a2e-91d9-7eec505cd049 req-34da2896-de6c-4bf0-9632-cf0490e4ef57 tempest-ServerActionsTestJSON-1674828100 tempest-ServerActionsTestJSON-1674828100-project-member] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 1144.266869] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 1144.268198] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.268198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.268198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.268198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.268198] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.268198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.268198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.274223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.274223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.274223] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.745554] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.776098] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.776267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.776399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.776669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.776740] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.776901] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.776998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.777078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.777226] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.777304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.777391] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 is going to be updated. [ 1144.817685] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.817930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.817930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.818149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.818309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.829049] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: IN_PROGRESS for 2s [ 1145.249179] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.249179] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.249179] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.249672] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.249830] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.250407] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.250407] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.251036] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.251036] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.251169] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.251302] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.251483] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.251669] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.251830] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.255026] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.255026] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.255026] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.274717] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.276422] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1145.276745] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.277105] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.277502] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-e1854e81-4cf2-48cb-9f9e-474b20ca3851 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.277764] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-e1854e81-4cf2-48cb-9f9e-474b20ca3851" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.277937] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-e1854e81-4cf2-48cb-9f9e-474b20ca3851" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.278394] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-e1854e81-4cf2-48cb-9f9e-474b20ca3851" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.278613] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1854e81-4cf2-48cb-9f9e-474b20ca3851',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.327210] env[70535]: INFO networking_nsxv3.common.synchronization [None req-0544e89d-169d-4f27-8e98-e8fb589f7463 tempest-ServerRescueNegativeTestJSON-1204437415 tempest-ServerRescueNegativeTestJSON-1204437415-project-member] Enqueued Resource ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 with Priority: HIGHEST for action security_group_rules [ 1145.327829] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 with Priority: HIGHEST for action security_group_rules [ 1145.328563] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.328768] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.328883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.329202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.329425] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ff34ce6-ae25-41d3-9f90-e1df4be5d574',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.451152] env[70535]: INFO networking_nsxv3.common.synchronization [None req-07802af4-b11c-4227-a9c2-a05013800f85 tempest-ServerRescueNegativeTestJSON-1204437415 tempest-ServerRescueNegativeTestJSON-1204437415-project-member] Enqueued Resource ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 with Priority: HIGHEST for action security_group_rules [ 1145.451404] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 with Priority: HIGHEST for action security_group_rules [ 1145.451715] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.451813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.706751] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1145.706938] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af deletion is rescheduled due to dependency. [ 1145.707087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.756605] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.756605] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.757490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.757490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.757490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.757490] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 is going to be updated. [ 1145.780997] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.781244] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.781380] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.781679] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.781840] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.782023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port e1854e81-4cf2-48cb-9f9e-474b20ca3851 not found, creating... [ 1145.782297] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.782488] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.782616] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.782844] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.783061] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.783390] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.783559] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.783721] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.783978] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.784149] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.784299] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: e1854e81-4cf2-48cb-9f9e-474b20ca3851 is going to be created. [ 1145.803942] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.804133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.804133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.804312] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.804464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.810845] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.811231] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.811283] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.811594] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.811862] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.812156] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-e1854e81-4cf2-48cb-9f9e-474b20ca3851" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.826192] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 in Status: IN_PROGRESS for 2s [ 1145.858241] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.858601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.858728] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.859437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.859555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.859836] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 already deleted. [ 1145.860249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.861201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.861615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.861923] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ff34ce6-ae25-41d3-9f90-e1df4be5d574',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.999027] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efe16881-900e-4f34-a1b9-20cdccf84a3f in Status: SUCCESS [ 1145.999027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.999027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.999027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.999027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.999027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.999027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.999027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.999713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.999973] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.000240] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.386373] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.388777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.388777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.388777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.388777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.388777] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 already deleted. [ 1146.388777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.502915] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.502915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.502915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.503201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.503201] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.503282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.503282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.503505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.503614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.503703] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.503854] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.503951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.504249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.504249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.504349] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.504409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.504487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.504764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.504844] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.504970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.505073] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.754872] env[70535]: INFO networking_nsxv3.common.synchronization [req-185aa477-1685-4be7-9d5d-d99dedbef15f req-6c488b9a-2c82-4403-93a0-9ee0ae5fe1a6 service nova] Enqueued Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_rules [ 1146.755062] env[70535]: INFO networking_nsxv3.common.synchronization [req-185aa477-1685-4be7-9d5d-d99dedbef15f req-6c488b9a-2c82-4403-93a0-9ee0ae5fe1a6 service nova] Enqueued Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_members [ 1146.755227] env[70535]: INFO networking_nsxv3.common.synchronization [req-185aa477-1685-4be7-9d5d-d99dedbef15f req-6c488b9a-2c82-4403-93a0-9ee0ae5fe1a6 service nova] Enqueued Resource ID: e1854e81-4cf2-48cb-9f9e-474b20ca3851 with Priority: HIGHEST for action port [ 1146.755911] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_rules [ 1146.756997] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_members [ 1146.757257] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1854e81-4cf2-48cb-9f9e-474b20ca3851 with Priority: HIGHEST for action port [ 1146.757685] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.757685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.757860] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.758012] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.758102] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.760175] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f11229e-4f65-4aab-a492-ad9dd37f60f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.760314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.760625] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1854e81-4cf2-48cb-9f9e-474b20ca3851 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.760766] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1854e81-4cf2-48cb-9f9e-474b20ca3851" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.760852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1854e81-4cf2-48cb-9f9e-474b20ca3851" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.761320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1854e81-4cf2-48cb-9f9e-474b20ca3851" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.762457] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1854e81-4cf2-48cb-9f9e-474b20ca3851',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.846280] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: SUCCESS [ 1146.847603] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 deletion is rescheduled due to dependency. [ 1146.847603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.007383] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efe16881-900e-4f34-a1b9-20cdccf84a3f: rpc.has_security_group_logging(os_id): False [ 1147.036864] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.036864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.036864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.036864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.064230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.064230] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.064230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.064230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.064230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.064230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.064230] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.064230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.064230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.064230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.064230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.065508] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.065508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.065508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.065508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.065508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.065508] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efe16881-900e-4f34-a1b9-20cdccf84a3f is going to be updated. [ 1147.140205] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.140205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.140205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.140418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.140418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.177156] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efe16881-900e-4f34-a1b9-20cdccf84a3f in Status: IN_PROGRESS for 2s [ 1147.263924] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f11229e-4f65-4aab-a492-ad9dd37f60f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.264067] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.264207] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1854e81-4cf2-48cb-9f9e-474b20ca3851 with status ACTIVE [ 1147.264388] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.264507] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.264571] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.264835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.264889] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.265076] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.265174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.265236] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.265394] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.265475] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.265654] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.265914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.265914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.265970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.265997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.266184] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1854e81-4cf2-48cb-9f9e-474b20ca3851 is going to be updated. [ 1147.301185] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.301185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.301185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.301185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.301185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.301185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1854e81-4cf2-48cb-9f9e-474b20ca3851" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.838304] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 in Status: SUCCESS [ 1147.838723] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.839791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.839791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.840186] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.840367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.840367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.840461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.840538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.840615] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.343730] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.848899] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.194490] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efe16881-900e-4f34-a1b9-20cdccf84a3f in Status: SUCCESS [ 1149.194715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.344577] env[70535]: INFO networking_nsxv3.common.synchronization [req-dc9083e4-9978-4fd5-8bb3-55c1ff4838cc req-52b94154-7126-4937-a147-2d7309c8c096 tempest-ListServerFiltersTestJSON-136218615 tempest-ListServerFiltersTestJSON-136218615-project-member] Enqueued Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1149.345157] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1149.347877] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.347877] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.347877] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.348158] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.348425] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.348589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.348701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.348951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.349112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.349275] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.354022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.354022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.355426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.355683] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.356516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.356516] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 is going to be updated. [ 1149.387597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.389826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.389826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.389826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.389826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.405027] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 in Status: IN_PROGRESS for 2s [ 1149.427305] env[70535]: INFO networking_nsxv3.common.synchronization [req-f63a8144-b9ab-42e0-a6da-89563e1f685f req-6e4a6ce9-097d-42e9-8ada-25d8657d67a3 tempest-MigrationsAdminTest-1671970304 tempest-MigrationsAdminTest-1671970304-project-member] Enqueued Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_members [ 1149.427939] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_members [ 1149.429401] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.429693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.430552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.430552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.430552] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.430779] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.430943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.431896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.431896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.431896] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.861474] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.934445] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.967653] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.968284] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.972017] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.972017] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.972017] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.972017] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.972017] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.972017] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.972017] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.972017] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1149.972017] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1149.972017] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1149.972017] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1149.972017] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1149.972017] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1149.972017] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1149.992505] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1149.992715] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1149.992861] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1149.995092] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-564" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.995092] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-bf5244cb-449f-453e-94eb-83727400de7b taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.995092] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-bf5244cb-449f-453e-94eb-83727400de7b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.995092] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-bf5244cb-449f-453e-94eb-83727400de7b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.995092] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-bf5244cb-449f-453e-94eb-83727400de7b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.995092] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5244cb-449f-453e-94eb-83727400de7b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.364422] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.442467] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.500139] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.500139] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.500139] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.500139] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.500139] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.500139] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port bf5244cb-449f-453e-94eb-83727400de7b not found, creating... [ 1150.500139] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.500139] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.500139] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.500139] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.500139] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.500593] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.500593] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.500593] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.500593] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.501113] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.502746] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: bf5244cb-449f-453e-94eb-83727400de7b is going to be created. [ 1150.534064] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.534064] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.534064] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.534064] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.534064] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.534064] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-bf5244cb-449f-453e-94eb-83727400de7b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.870658] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.871115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.871115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.871208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.872221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.872221] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e is going to be updated. [ 1150.946452] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.946695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.946796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.947120] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.947291] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.947447] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b is going to be updated. [ 1150.993564] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.993564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.993564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.993564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.993564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.011641] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: IN_PROGRESS for 2s [ 1151.014021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.014522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.014767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.015137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.017102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.036039] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b in Status: IN_PROGRESS for 2s [ 1151.428204] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 in Status: SUCCESS [ 1151.428204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.428204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.428204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.428204] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.428204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.428204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.428204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.428204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.428204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.428204] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.508231] env[70535]: INFO networking_nsxv3.common.synchronization [req-f63a8144-b9ab-42e0-a6da-89563e1f685f req-cc76c9bc-f2fd-4dbb-aac5-993954062da0 service nova] Enqueued Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_rules [ 1151.508231] env[70535]: INFO networking_nsxv3.common.synchronization [req-f63a8144-b9ab-42e0-a6da-89563e1f685f req-cc76c9bc-f2fd-4dbb-aac5-993954062da0 service nova] Enqueued Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_members [ 1151.510196] env[70535]: INFO networking_nsxv3.common.synchronization [req-f63a8144-b9ab-42e0-a6da-89563e1f685f req-cc76c9bc-f2fd-4dbb-aac5-993954062da0 service nova] Enqueued Resource ID: bf5244cb-449f-453e-94eb-83727400de7b with Priority: HIGHEST for action port [ 1151.510908] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_rules [ 1151.510979] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_members [ 1151.511088] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5244cb-449f-453e-94eb-83727400de7b with Priority: HIGHEST for action port [ 1151.511374] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.511531] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.511602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.511813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.511892] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.512735] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.512837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.516960] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf5244cb-449f-453e-94eb-83727400de7b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.517136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf5244cb-449f-453e-94eb-83727400de7b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.517208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf5244cb-449f-453e-94eb-83727400de7b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.517409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf5244cb-449f-453e-94eb-83727400de7b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.517496] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5244cb-449f-453e-94eb-83727400de7b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.816967] env[70535]: INFO networking_nsxv3.common.synchronization [req-7e74e643-2d6e-4977-b22a-384a56faa368 req-b1ac815d-0e59-465c-91cc-20a03f5ffa0e tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_members [ 1151.816967] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_members [ 1151.817184] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-597eb346-7afe-45b2-a812-9f2a8e62680f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.817184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.817327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.817452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.817656] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.818140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.818140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.818140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.818140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.818140] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.931925] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.019149] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.019294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.020935] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf5244cb-449f-453e-94eb-83727400de7b with status ACTIVE [ 1152.021166] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.021296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.021366] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.021580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.021673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.021866] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.022078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.022078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.022204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.022292] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.022475] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.022575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.022637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.022824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.022935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.023128] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf5244cb-449f-453e-94eb-83727400de7b is going to be updated. [ 1152.048568] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.048568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.048568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.048568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.048568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.048568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf5244cb-449f-453e-94eb-83727400de7b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.307783] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.308056] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.308146] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.308534] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.308857] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.309052] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.309186] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.309458] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.309646] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.309903] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1152.310040] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.310163] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.310278] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.310402] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1152.310512] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.310660] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.322093] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.333442] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.333698] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1152.333855] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.334055] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-442" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.334391] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-58638020-105d-4552-8f1e-42ced7da1c54 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.335096] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-58638020-105d-4552-8f1e-42ced7da1c54" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.335096] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-58638020-105d-4552-8f1e-42ced7da1c54" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.335096] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-58638020-105d-4552-8f1e-42ced7da1c54" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.335349] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58638020-105d-4552-8f1e-42ced7da1c54',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.434027] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f11229e-4f65-4aab-a492-ad9dd37f60f1: rpc.has_security_group_logging(os_id): False [ 1152.467992] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.468221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.468221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.468499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.488997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.489466] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.489663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.489801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.490098] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.490268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.490434] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 is going to be updated. [ 1152.557771] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.558011] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.558088] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.558313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.558541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.573860] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 in Status: IN_PROGRESS for 2s [ 1152.827408] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.841023] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.841023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.841023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.841023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.841023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.841023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 58638020-105d-4552-8f1e-42ced7da1c54 not found, creating... [ 1152.841023] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.841023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.841023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.841023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.841023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.841591] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.841591] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.841591] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.841591] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.843362] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.843761] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 58638020-105d-4552-8f1e-42ced7da1c54 is going to be created. [ 1152.877652] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.877652] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.877652] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.878085] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.878431] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.879283] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-58638020-105d-4552-8f1e-42ced7da1c54" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.038999] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: SUCCESS [ 1153.038999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.049781] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b in Status: SUCCESS [ 1153.050017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.050220] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.052025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.052025] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.052025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.052025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.052025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.052025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.052025] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.331367] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.331367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.331600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.332280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.332280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.332280] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 597eb346-7afe-45b2-a812-9f2a8e62680f is going to be updated. [ 1153.374455] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.374722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.375122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.375263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.375332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.389500] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 597eb346-7afe-45b2-a812-9f2a8e62680f in Status: IN_PROGRESS for 2s [ 1153.553254] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.055931] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.120626] env[70535]: INFO networking_nsxv3.common.synchronization [req-7e74e643-2d6e-4977-b22a-384a56faa368 req-c566b966-3644-4fbf-bac9-bbc9cc14e143 service nova] Enqueued Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_rules [ 1154.120626] env[70535]: INFO networking_nsxv3.common.synchronization [req-7e74e643-2d6e-4977-b22a-384a56faa368 req-c566b966-3644-4fbf-bac9-bbc9cc14e143 service nova] Enqueued Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_members [ 1154.120976] env[70535]: INFO networking_nsxv3.common.synchronization [req-7e74e643-2d6e-4977-b22a-384a56faa368 req-c566b966-3644-4fbf-bac9-bbc9cc14e143 service nova] Enqueued Resource ID: 58638020-105d-4552-8f1e-42ced7da1c54 with Priority: HIGHEST for action port [ 1154.122756] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_rules [ 1154.122756] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_members [ 1154.122756] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58638020-105d-4552-8f1e-42ced7da1c54 with Priority: HIGHEST for action port [ 1154.123039] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-597eb346-7afe-45b2-a812-9f2a8e62680f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.123133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.123216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.123481] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.125160] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.127364] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-597eb346-7afe-45b2-a812-9f2a8e62680f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.128934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.128934] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-58638020-105d-4552-8f1e-42ced7da1c54 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.128934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58638020-105d-4552-8f1e-42ced7da1c54" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.128934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58638020-105d-4552-8f1e-42ced7da1c54" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.129192] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58638020-105d-4552-8f1e-42ced7da1c54" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.129192] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58638020-105d-4552-8f1e-42ced7da1c54',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.563364] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.563364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.563364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.563364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.563364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.563364] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b is going to be updated. [ 1154.592948] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 in Status: SUCCESS [ 1154.592948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.596524] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.596721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.596950] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.597211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.597430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.609940] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b in Status: IN_PROGRESS for 2s [ 1154.630513] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-597eb346-7afe-45b2-a812-9f2a8e62680f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.630763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.632183] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58638020-105d-4552-8f1e-42ced7da1c54 with status ACTIVE [ 1154.632388] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.632513] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.632585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.632800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.632891] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.633078] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.633178] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.633239] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.633391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.633468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.633679] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.633794] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.633857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.634008] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.634089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.634177] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58638020-105d-4552-8f1e-42ced7da1c54 is going to be updated. [ 1154.656711] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.656960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.657574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.657574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.657574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.657769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58638020-105d-4552-8f1e-42ced7da1c54" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.400431] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 597eb346-7afe-45b2-a812-9f2a8e62680f in Status: SUCCESS [ 1155.400700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.400870] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.401122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.401407] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.401558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.401637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.401846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.401967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.402169] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.904681] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.407992] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.626654] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b in Status: SUCCESS [ 1156.626963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.627123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.628039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.628039] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.628039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.628039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.628039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.628039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.628361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.628361] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.693038] env[70535]: INFO networking_nsxv3.common.synchronization [None req-0e8bcfa2-8f5e-41ba-9584-581995101edb tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1156.693038] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1156.693038] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.693038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.693038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.693038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.693731] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.694051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.694203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.694442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.694791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.695015] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.700858] env[70535]: INFO networking_nsxv3.common.synchronization [req-38512bd7-41ab-4100-bcf1-2679b3714994 req-11c80c10-0b1a-406b-9f1a-dc5e6d6bbbf8 tempest-ServersAdminNegativeTestJSON-1138087894 tempest-ServersAdminNegativeTestJSON-1138087894-project-member] Enqueued Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_members [ 1156.700858] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_members [ 1156.700858] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.700858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.700858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.700858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.700858] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.700858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.700858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.700858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.700858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.700858] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.912960] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.912960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.912960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.912960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.912960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.912960] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 597eb346-7afe-45b2-a812-9f2a8e62680f is going to be updated. [ 1156.948422] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.948858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.949050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.949360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.949835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.963307] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 597eb346-7afe-45b2-a812-9f2a8e62680f in Status: IN_PROGRESS for 2s [ 1157.007302] env[70535]: INFO networking_nsxv3.common.synchronization [req-a18a6445-36bf-45a9-ade8-eebccc4cb98f req-8ca8c54f-892a-4b71-b8ff-5d76b9662c24 tempest-ServersTestJSON-886254797 tempest-ServersTestJSON-886254797-project-member] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1157.007903] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1157.008257] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.008402] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.008514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.008749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.008895] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.009099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.011020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.011101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.011225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.011666] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.133563] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.133563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.133563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.133887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.135392] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.135392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.135392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.135392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.135392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.135392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.135392] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.135392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.135392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.135392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.135392] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.135873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.135873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.135873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.135873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.135979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.136127] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.142325] env[70535]: INFO networking_nsxv3.common.synchronization [req-bcb4cbfe-40bd-41ec-8650-4133e3578259 req-6f645f52-832a-48e2-853c-7d97ee7d3c89 tempest-ServersNegativeTestJSON-1344173276 tempest-ServersNegativeTestJSON-1344173276-project-member] Enqueued Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_members [ 1157.142325] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGHEST for action security_group_members [ 1157.142325] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.142466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.142466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.142776] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.142859] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.142935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.142935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.143183] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.143309] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.143372] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.199345] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.199627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.199701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.199926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.200026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.200244] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.200359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.200423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.202019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.202019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.202019] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be deleted. [ 1157.202019] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.269548] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.269707] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.270626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.270626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.270626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.270626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.515928] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.640045] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b: rpc.has_security_group_logging(os_id): False [ 1157.645946] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.646803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.647101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.647533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.650047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.650047] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.650047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.650047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.650047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.650047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.650047] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 is going to be updated. [ 1157.660621] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.660840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.660981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.661188] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.680707] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.680875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.680960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.682163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.684934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.693208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.693208] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.693364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.693364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.693527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.693611] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.693838] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.693963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.694039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.694299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.694299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.694488] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.694590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.694674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.694790] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.694870] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.694960] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b is going to be updated. [ 1157.701852] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: IN_PROGRESS for 2s [ 1157.705040] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.839499] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.839714] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.839714] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.839970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.840142] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.858264] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.858626] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.858792] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.861173] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.861173] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.861173] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.861173] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.861173] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.861173] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.861173] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.861173] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.861173] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.861173] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.861173] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.861173] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.861863] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.864982] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b in Status: IN_PROGRESS for 2s [ 1157.896924] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.897216] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1157.897379] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.897637] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.898202] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-ba6576a0-981f-4d89-a46c-ee6e0aece7ac taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.898370] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-ba6576a0-981f-4d89-a46c-ee6e0aece7ac" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.898456] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-ba6576a0-981f-4d89-a46c-ee6e0aece7ac" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.898925] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-ba6576a0-981f-4d89-a46c-ee6e0aece7ac" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.899102] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba6576a0-981f-4d89-a46c-ee6e0aece7ac',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.018314] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.208426] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.208720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.208830] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.209091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.209196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.209309] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efe16881-900e-4f34-a1b9-20cdccf84a3f is going to be updated. [ 1158.262701] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.262955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.262955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.263155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.263302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.275760] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efe16881-900e-4f34-a1b9-20cdccf84a3f in Status: IN_PROGRESS for 2s [ 1158.402815] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.403281] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.404406] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.404406] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.404406] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.405032] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port ba6576a0-981f-4d89-a46c-ee6e0aece7ac not found, creating... [ 1158.408138] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.408138] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.408594] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.409130] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.409524] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.410316] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.410688] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.412344] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.412598] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.412951] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.413525] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: ba6576a0-981f-4d89-a46c-ee6e0aece7ac is going to be created. [ 1158.440591] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.440783] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.440939] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.441273] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.441576] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.441819] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-ba6576a0-981f-4d89-a46c-ee6e0aece7ac" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.521741] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.522063] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.522111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.522340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.522439] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.522540] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1158.593729] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.593914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.593985] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.594346] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.594551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.613431] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1158.979217] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 597eb346-7afe-45b2-a812-9f2a8e62680f in Status: SUCCESS [ 1158.979382] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.979550] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.980166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.980166] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.980166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.980340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.980405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.980488] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.980518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.980647] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.484251] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.609320] env[70535]: INFO networking_nsxv3.common.synchronization [req-a18a6445-36bf-45a9-ade8-eebccc4cb98f req-e7ff4fa7-cd53-4f0c-b2ee-54e26b62624c service nova] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_rules [ 1159.609320] env[70535]: INFO networking_nsxv3.common.synchronization [req-a18a6445-36bf-45a9-ade8-eebccc4cb98f req-e7ff4fa7-cd53-4f0c-b2ee-54e26b62624c service nova] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1159.609320] env[70535]: INFO networking_nsxv3.common.synchronization [req-a18a6445-36bf-45a9-ade8-eebccc4cb98f req-e7ff4fa7-cd53-4f0c-b2ee-54e26b62624c service nova] Enqueued Resource ID: ba6576a0-981f-4d89-a46c-ee6e0aece7ac with Priority: HIGHEST for action port [ 1159.612024] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_rules [ 1159.612024] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1159.612024] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6576a0-981f-4d89-a46c-ee6e0aece7ac with Priority: HIGHEST for action port [ 1159.612024] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.612024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.612024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.612024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.612024] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.612678] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.612678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.612794] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba6576a0-981f-4d89-a46c-ee6e0aece7ac taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.613823] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba6576a0-981f-4d89-a46c-ee6e0aece7ac" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.613823] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba6576a0-981f-4d89-a46c-ee6e0aece7ac" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.613823] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba6576a0-981f-4d89-a46c-ee6e0aece7ac" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.613823] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba6576a0-981f-4d89-a46c-ee6e0aece7ac',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.716990] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 in Status: SUCCESS [ 1159.717211] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 deletion is rescheduled due to dependency. [ 1159.717334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.882332] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b in Status: SUCCESS [ 1159.883142] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.989681] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 597eb346-7afe-45b2-a812-9f2a8e62680f: rpc.has_security_group_logging(os_id): False [ 1160.014322] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.014481] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.014597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.014847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.041952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.042214] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.042343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.042410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.042628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.042716] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.042808] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 597eb346-7afe-45b2-a812-9f2a8e62680f is going to be updated. [ 1160.114778] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.114984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.114984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.115251] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.115394] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.117051] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.117225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.117411] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba6576a0-981f-4d89-a46c-ee6e0aece7ac with status ACTIVE [ 1160.117700] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.117986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.117986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.118804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.118804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.119198] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.119408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.119542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.119776] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.119893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.120181] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.120258] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.120367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.120624] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.121121] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.121434] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba6576a0-981f-4d89-a46c-ee6e0aece7ac is going to be updated. [ 1160.150248] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 597eb346-7afe-45b2-a812-9f2a8e62680f in Status: IN_PROGRESS for 2s [ 1160.155142] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.155323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.155385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.155616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.155755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.155930] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba6576a0-981f-4d89-a46c-ee6e0aece7ac" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.289224] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efe16881-900e-4f34-a1b9-20cdccf84a3f in Status: SUCCESS [ 1160.289457] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.630440] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1160.630770] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.630898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.631150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.631353] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.631557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.631635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.631811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.631891] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.632111] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.138255] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.643263] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.148828] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.149134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.149134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.149602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.149602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.149710] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1162.175552] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 597eb346-7afe-45b2-a812-9f2a8e62680f in Status: SUCCESS [ 1162.175707] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.198212] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.198378] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.198464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.198820] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.199206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.209352] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1164.221947] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1164.223308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.223308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.223308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.223308] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.223308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.223308] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.223645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.223645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.223645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.223645] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.519773] env[70535]: INFO networking_nsxv3.common.synchronization [req-a894c205-f115-49e7-a9bf-f84b43405c0f req-90d6552d-769f-43cb-87b7-32d8cc9370c1 tempest-ServerRescueNegativeTestJSON-1204437415 tempest-ServerRescueNegativeTestJSON-1204437415-project-member] Enqueued Resource ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 with Priority: HIGHEST for action security_group_members [ 1164.520451] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 with Priority: HIGHEST for action security_group_members [ 1164.520785] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.524616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.524616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.524616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.524616] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.524616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.524616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.524616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.524616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.524616] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff34ce6-ae25-41d3-9f90-e1df4be5d574',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.726099] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.726428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.726624] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.726913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.727136] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.727618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.727618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.727618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.727618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.727771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.727887] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.727990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.728285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.728285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.728442] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.728541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.728649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.728782] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.728865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.728951] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.729055] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.029042] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.029248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.029248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.029476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.029569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.029788] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.029885] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.029943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.030127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.030202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.030285] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 already deleted. [ 1165.030363] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.232262] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3608197f-2b1a-43a5-a7dc-0f91c90db3f1: rpc.has_security_group_logging(os_id): False [ 1165.266039] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.266245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.266347] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.266658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.266789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.267111] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.267258] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.267351] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.267589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.267704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.268045] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.270479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.270479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.270479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.270479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.270479] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.270725] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.270725] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.270824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.271478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.271478] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1165.355498] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.355756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.355836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.356042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.356230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.371852] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1165.586030] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.586030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-281" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.586030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-281" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.586030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-281" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.586030] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.586030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.586030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.586030] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.586467] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.586467] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.587108] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.587108] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.587108] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.587108] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.587408] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.587408] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.643495] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.643495] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.056 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1165.643495] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.644291] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-281" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.645398] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-2ba54c90-eb76-428e-b3da-181f80add31d taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.645398] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-2ba54c90-eb76-428e-b3da-181f80add31d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.645398] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-2ba54c90-eb76-428e-b3da-181f80add31d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.645824] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-2ba54c90-eb76-428e-b3da-181f80add31d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.645971] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ba54c90-eb76-428e-b3da-181f80add31d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.111191] env[70535]: INFO networking_nsxv3.common.synchronization [None req-ad2b357a-703e-47be-b2b3-ab017e2311e3 None None] Enqueued Resource ID: 118fdc74-b116-4ecd-91dd-aa87c25b6a84 with Priority: HIGHEST for action port [ 1166.111191] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118fdc74-b116-4ecd-91dd-aa87c25b6a84 with Priority: HIGHEST for action port [ 1166.111191] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-118fdc74-b116-4ecd-91dd-aa87c25b6a84 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.111191] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-118fdc74-b116-4ecd-91dd-aa87c25b6a84" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.111967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-118fdc74-b116-4ecd-91dd-aa87c25b6a84" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.112701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-118fdc74-b116-4ecd-91dd-aa87c25b6a84" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.113423] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('118fdc74-b116-4ecd-91dd-aa87c25b6a84',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.151270] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.151270] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.151270] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.151270] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.151270] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.151270] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 2ba54c90-eb76-428e-b3da-181f80add31d not found, creating... [ 1166.151270] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.152081] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.152536] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.153197] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.153637] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.154314] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.154807] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.156124] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.156124] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.156124] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.156124] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 2ba54c90-eb76-428e-b3da-181f80add31d is going to be created. [ 1166.210900] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.210900] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.210900] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.210900] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.210900] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.210900] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-2ba54c90-eb76-428e-b3da-181f80add31d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.616113] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 118fdc74-b116-4ecd-91dd-aa87c25b6a84 [ 1166.616911] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.616911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.616911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.616911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.618406] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.618406] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:118fdc74-b116-4ecd-91dd-aa87c25b6a84 already deleted. [ 1166.618406] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-118fdc74-b116-4ecd-91dd-aa87c25b6a84" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.370528] env[70535]: INFO networking_nsxv3.common.synchronization [req-a894c205-f115-49e7-a9bf-f84b43405c0f req-09117346-c7d5-4238-ad9d-d84821473805 service nova] Enqueued Resource ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 with Priority: HIGHEST for action security_group_rules [ 1167.370528] env[70535]: INFO networking_nsxv3.common.synchronization [req-a894c205-f115-49e7-a9bf-f84b43405c0f req-09117346-c7d5-4238-ad9d-d84821473805 service nova] Enqueued Resource ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 with Priority: HIGHEST for action security_group_members [ 1167.370528] env[70535]: INFO networking_nsxv3.common.synchronization [req-a894c205-f115-49e7-a9bf-f84b43405c0f req-09117346-c7d5-4238-ad9d-d84821473805 service nova] Enqueued Resource ID: 2ba54c90-eb76-428e-b3da-181f80add31d with Priority: HIGHEST for action port [ 1167.370528] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 with Priority: HIGHEST for action security_group_rules [ 1167.370528] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 with Priority: HIGHEST for action security_group_members [ 1167.370528] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ba54c90-eb76-428e-b3da-181f80add31d with Priority: HIGHEST for action port [ 1167.374974] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.374974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.374974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.374974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.374974] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ff34ce6-ae25-41d3-9f90-e1df4be5d574',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.374974] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.375237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.375237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.375635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.375635] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.375635] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.375771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.375820] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.376816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.376816] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff34ce6-ae25-41d3-9f90-e1df4be5d574',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.377202] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ba54c90-eb76-428e-b3da-181f80add31d taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.377354] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ba54c90-eb76-428e-b3da-181f80add31d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.377479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ba54c90-eb76-428e-b3da-181f80add31d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.377655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ba54c90-eb76-428e-b3da-181f80add31d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.377814] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ba54c90-eb76-428e-b3da-181f80add31d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.416943] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1167.417465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.541643] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.541911] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.542178] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.542482] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.542769] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.542992] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.543069] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.543304] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.543522] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.544056] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1167.544238] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1167.544794] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1167.544794] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1167.544794] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1167.544794] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1167.544997] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1167.570370] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1167.570576] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1167.570727] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1167.570936] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.571299] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-6daf8085-f101-435b-b6f1-8f054b068aa9 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.571483] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.571610] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.571961] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.572154] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6daf8085-f101-435b-b6f1-8f054b068aa9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.879382] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.879659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.882262] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ba54c90-eb76-428e-b3da-181f80add31d with status ACTIVE [ 1167.882262] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.882262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.882262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.882262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.882262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.882262] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.882262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.882262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.882690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.882690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.882690] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.882855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.882855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.882919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.882980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.883134] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ba54c90-eb76-428e-b3da-181f80add31d is going to be updated. [ 1167.886922] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff34ce6-ae25-41d3-9f90-e1df4be5d574',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.913015] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.913215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.913265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.913456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.913595] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.913759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ba54c90-eb76-428e-b3da-181f80add31d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.075320] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.075599] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.075730] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.076132] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.076303] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.076518] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 6daf8085-f101-435b-b6f1-8f054b068aa9 not found, creating... [ 1168.076832] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.077010] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.077151] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.077379] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.077523] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.077809] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.078010] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.078154] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.078371] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.078512] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.078696] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 6daf8085-f101-435b-b6f1-8f054b068aa9 is going to be created. [ 1168.119782] env[70535]: INFO networking_nsxv3.common.synchronization [req-495830bb-aaae-4a90-af5b-d8ea659889e5 req-101cf3a0-f455-497c-8620-2d52f4880e65 tempest-ListServerFiltersTestJSON-136218615 tempest-ListServerFiltersTestJSON-136218615-project-member] Enqueued Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1168.122509] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.122733] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.122864] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.123282] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.123556] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.123800] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.125312] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1168.125706] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.125859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.125938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.126872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.127070] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.127190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.127259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.127438] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.127525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.127624] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.392083] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff34ce6-ae25-41d3-9f90-e1df4be5d574',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.630593] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.721535] env[70535]: INFO networking_nsxv3.common.synchronization [None req-2555f72b-ae38-47e3-a2d1-0186e6d4eb61 None None] Enqueued Resource ID: a2a2b6be-0bf3-4885-9d34-bf8bd72a2123 with Priority: HIGHEST for action port [ 1168.722425] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2a2b6be-0bf3-4885-9d34-bf8bd72a2123 with Priority: HIGHEST for action port [ 1168.723096] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2a2b6be-0bf3-4885-9d34-bf8bd72a2123 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.723096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2a2b6be-0bf3-4885-9d34-bf8bd72a2123" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.723096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2a2b6be-0bf3-4885-9d34-bf8bd72a2123" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.723325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2a2b6be-0bf3-4885-9d34-bf8bd72a2123" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.723325] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2a2b6be-0bf3-4885-9d34-bf8bd72a2123',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.898338] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.898843] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.898843] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.899105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.899356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.899465] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 is going to be created. [ 1168.930752] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.930752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.930752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.930752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.931509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.944432] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 in Status: UNINITIALIZED for 2s [ 1169.132549] env[70535]: INFO networking_nsxv3.common.synchronization [req-0e0382dc-de46-412c-be79-0b72e214a794 req-651d358e-3a80-4294-bbc8-a4ece29d0a8d service nova] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_rules [ 1169.132814] env[70535]: INFO networking_nsxv3.common.synchronization [req-0e0382dc-de46-412c-be79-0b72e214a794 req-651d358e-3a80-4294-bbc8-a4ece29d0a8d service nova] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1169.132974] env[70535]: INFO networking_nsxv3.common.synchronization [req-0e0382dc-de46-412c-be79-0b72e214a794 req-651d358e-3a80-4294-bbc8-a4ece29d0a8d service nova] Enqueued Resource ID: 6daf8085-f101-435b-b6f1-8f054b068aa9 with Priority: HIGHEST for action port [ 1169.133559] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.136114] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_rules [ 1169.136261] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1169.136336] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6daf8085-f101-435b-b6f1-8f054b068aa9 with Priority: HIGHEST for action port [ 1169.137947] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.137947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.137947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.137947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.137947] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.138622] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.138762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.138830] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.138993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.142486] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.142486] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.142486] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.142666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.142666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.142733] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.147544] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-6daf8085-f101-435b-b6f1-8f054b068aa9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.147667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.147754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.147917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.148030] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6daf8085-f101-435b-b6f1-8f054b068aa9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.226033] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2a2b6be-0bf3-4885-9d34-bf8bd72a2123 [ 1169.226867] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.226867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.226867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.227729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.227843] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.227944] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2a2b6be-0bf3-4885-9d34-bf8bd72a2123 already deleted. [ 1169.228038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2a2b6be-0bf3-4885-9d34-bf8bd72a2123" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.637994] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.638497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.638497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.638594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.638716] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.638758] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e is going to be updated. [ 1169.648228] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.649446] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.649607] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.655020] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6daf8085-f101-435b-b6f1-8f054b068aa9 with status ACTIVE [ 1169.655020] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.655020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.655020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.655020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.655020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.655020] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.655020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.655020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.655020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.655020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.655020] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.655020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.655020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.655020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.655020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.655020] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6daf8085-f101-435b-b6f1-8f054b068aa9 is going to be updated. [ 1169.680802] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.680802] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.680802] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.680802] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.680802] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.680802] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.685157] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.687485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.687485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.687485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.687485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.706299] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: IN_PROGRESS for 2s [ 1169.753756] env[70535]: INFO networking_nsxv3.common.synchronization [None req-f68baa55-58cd-4173-99b6-1541eae34f8c None None] Enqueued Resource ID: fbbf1eb4-881d-4f55-b2ef-11070d645824 with Priority: HIGHEST for action port [ 1169.754715] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbbf1eb4-881d-4f55-b2ef-11070d645824 with Priority: HIGHEST for action port [ 1169.757831] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbbf1eb4-881d-4f55-b2ef-11070d645824 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.758586] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbbf1eb4-881d-4f55-b2ef-11070d645824" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.758586] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbbf1eb4-881d-4f55-b2ef-11070d645824" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.758586] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbbf1eb4-881d-4f55-b2ef-11070d645824" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.763256] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbbf1eb4-881d-4f55-b2ef-11070d645824',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.150824] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.265288] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbbf1eb4-881d-4f55-b2ef-11070d645824 [ 1170.266159] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.266159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.266159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.266159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.266159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.266159] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbbf1eb4-881d-4f55-b2ef-11070d645824 already deleted. [ 1170.266561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbbf1eb4-881d-4f55-b2ef-11070d645824" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.654158] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.654367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.654412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.654614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.654713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.654814] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be created. [ 1170.683680] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.683850] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.683915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.684541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.684541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.695801] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: UNINITIALIZED for 2s [ 1170.969574] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 in Status: SUCCESS [ 1170.972533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.972533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.972533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.972533] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.972533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.972533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.972533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.972533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.972533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.972533] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ff34ce6-ae25-41d3-9f90-e1df4be5d574',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.474539] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ff34ce6-ae25-41d3-9f90-e1df4be5d574',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.713446] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: SUCCESS [ 1171.713669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.962817] env[70535]: INFO networking_nsxv3.common.synchronization [None req-5f9a6d38-e000-4aae-ba14-7245f0dfdec3 None None] Enqueued Resource ID: 877cefc1-b48d-425e-b89c-85ffb0c219cc with Priority: HIGHEST for action port [ 1171.963125] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 877cefc1-b48d-425e-b89c-85ffb0c219cc with Priority: HIGHEST for action port [ 1171.963975] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-877cefc1-b48d-425e-b89c-85ffb0c219cc taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.963975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-877cefc1-b48d-425e-b89c-85ffb0c219cc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.963975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-877cefc1-b48d-425e-b89c-85ffb0c219cc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.964484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-877cefc1-b48d-425e-b89c-85ffb0c219cc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.965063] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('877cefc1-b48d-425e-b89c-85ffb0c219cc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.978286] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ff34ce6-ae25-41d3-9f90-e1df4be5d574: rpc.has_security_group_logging(os_id): False [ 1172.009044] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.009179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.009179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.009370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.009465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.009767] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.009902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.009967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.010151] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.010248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.010363] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 is going to be created. [ 1172.108830] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.109078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.109231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.109506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.109875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.125054] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 in Status: IN_PROGRESS for 2s [ 1172.469136] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 877cefc1-b48d-425e-b89c-85ffb0c219cc [ 1172.469136] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.469136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.469136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.469136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.469136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.469136] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:877cefc1-b48d-425e-b89c-85ffb0c219cc already deleted. [ 1172.469136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-877cefc1-b48d-425e-b89c-85ffb0c219cc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.707179] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 1172.707567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.707675] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.707941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.708177] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.708316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.708366] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.708548] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.708653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.708737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.708842] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.211307] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.211933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.211933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.211933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.212150] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.212246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.212246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.212435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.212549] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.212674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.212872] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.212998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.213094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.213282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.213465] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.213597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.213682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.213933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.213980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.214351] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.214351] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.410525] env[70535]: INFO networking_nsxv3.common.synchronization [req-7b5a4046-11d3-41f7-ba41-b7587ad5eb2c req-f3912ef6-3ca6-4e07-aa74-23fa1044ba0b tempest-ServersTestMultiNic-1028446262 tempest-ServersTestMultiNic-1028446262-project-member] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1173.411076] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1173.412206] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.412206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.412206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.416812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.417027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.417146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.417205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.417488] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.417488] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.417595] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.717692] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63056e22-45eb-4c1b-b65b-578fb5876c5b: rpc.has_security_group_logging(os_id): False [ 1173.738218] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.738415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.738498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.738847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.738977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.739251] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.739360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.739426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.739749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.739811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.743110] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.743275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.743355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.743558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.743646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.743848] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.743952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.744028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.744184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.744263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.744349] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be created. [ 1173.816146] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.816353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.816419] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.816691] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.816883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.841654] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: IN_PROGRESS for 2s [ 1173.923723] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.923929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.924022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.924265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.924338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.924545] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.924712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.924712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.924852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.924924] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.925021] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1173.981963] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.982437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.982571] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.982826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.982983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.996205] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1174.146291] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 in Status: SUCCESS [ 1174.146716] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.185094] env[70535]: INFO networking_nsxv3.common.synchronization [req-7b5a4046-11d3-41f7-ba41-b7587ad5eb2c req-8a1f286a-4cc8-44b7-9700-6b7fded864d6 tempest-ServersTestMultiNic-1028446262 tempest-ServersTestMultiNic-1028446262-project-member] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1174.185719] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1174.187456] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.187636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.024465] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.024761] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-350" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.024809] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-350" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.026470] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-350" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.026470] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.026470] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.026470] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.027355] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.028029] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.028029] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.028029] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.028183] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.028183] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.029717] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.029717] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.029717] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.047450] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.047615] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1175.047854] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.048023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-350" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.048503] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-9ac50be9-37f9-42ba-8038-f1feebfe9418 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.048739] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-9ac50be9-37f9-42ba-8038-f1feebfe9418" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.048896] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-9ac50be9-37f9-42ba-8038-f1feebfe9418" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.049819] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-9ac50be9-37f9-42ba-8038-f1feebfe9418" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.049819] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ac50be9-37f9-42ba-8038-f1feebfe9418',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.146289] env[70535]: INFO networking_nsxv3.common.synchronization [req-d237bb35-49d4-44ed-ab5f-681e272cfe3b req-bcb88010-bfcc-4aaa-aeae-3431a02c9fb1 tempest-ServersTestJSON-886254797 tempest-ServersTestJSON-886254797-project-member] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1175.146995] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1175.148596] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.149352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.149490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.149771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.149990] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.150152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.150247] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.150450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.150573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.150698] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.557903] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.558402] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.558856] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.559811] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.560222] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.560514] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 9ac50be9-37f9-42ba-8038-f1feebfe9418 not found, creating... [ 1175.562603] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.562965] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.563229] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.567444] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.567444] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.567444] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.567444] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.567444] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.567444] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.567444] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.567444] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 9ac50be9-37f9-42ba-8038-f1feebfe9418 is going to be created. [ 1175.596568] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.598470] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.598562] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.598912] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.599305] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.599590] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-9ac50be9-37f9-42ba-8038-f1feebfe9418" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.654655] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.793698] env[70535]: INFO networking_nsxv3.common.synchronization [req-1ea4d8c3-a8ba-4de2-9c81-8b0099acfa25 req-86956ad7-f8d1-42a0-8b1b-a3fae3282d86 tempest-ServerRescueTestJSON-1736721769 tempest-ServerRescueTestJSON-1736721769-project-member] Enqueued Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_members [ 1175.794282] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_members [ 1175.794624] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.794753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.794816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.795523] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.795745] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.795853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.795922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.796114] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.796208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.796308] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.865813] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 1175.866063] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.880963] env[70535]: INFO networking_nsxv3.common.synchronization [req-5da41c92-9ed7-4162-b33d-b3aeb177c415 req-7ceb1c1c-b234-45f5-8803-f91fb078e53f tempest-ServersAdminNegativeTestJSON-1138087894 tempest-ServersAdminNegativeTestJSON-1138087894-project-member] Enqueued Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_members [ 1175.881547] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGHEST for action security_group_members [ 1175.881872] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.882009] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.882298] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.882527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.882698] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.882812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.882877] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.883045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.883135] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.883413] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.006372] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1176.006615] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af deletion is rescheduled due to dependency. [ 1176.006761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.006972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.007271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.007525] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.007668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.007754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.007976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.008107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.008237] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.157482] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.298877] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.385478] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.385656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.385731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.385945] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.386055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.386253] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.386356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.386419] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.386581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.387380] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.387380] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efe16881-900e-4f34-a1b9-20cdccf84a3f is going to be updated. [ 1176.403024] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-764 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.403024] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-764" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.403024] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-764" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.403024] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-764" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.403024] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.403024] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.403024] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.403419] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.403419] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.403595] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1176.403707] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1176.404089] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1176.404212] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1176.404329] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1176.404438] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1176.404575] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1176.429258] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1176.429466] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1176.429610] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1176.429808] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-764" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.430160] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-0490ed55-5e6b-4d4a-a031-6907967ebc4a taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.430338] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-0490ed55-5e6b-4d4a-a031-6907967ebc4a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.430459] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-0490ed55-5e6b-4d4a-a031-6907967ebc4a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.430779] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-0490ed55-5e6b-4d4a-a031-6907967ebc4a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.430923] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0490ed55-5e6b-4d4a-a031-6907967ebc4a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.432493] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.432615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.432692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.432873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.436048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.448456] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efe16881-900e-4f34-a1b9-20cdccf84a3f in Status: IN_PROGRESS for 2s [ 1176.511456] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.511651] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.511777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.511996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.512143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.512380] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.512489] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.512553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.512718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.512800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.512888] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1176.540429] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.544017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.544017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.544017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.544017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.564297] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1176.566228] env[70535]: INFO networking_nsxv3.common.synchronization [req-7b5a4046-11d3-41f7-ba41-b7587ad5eb2c req-f2f9f317-717c-4aff-ace0-19de124a3cc7 service nova] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_rules [ 1176.566408] env[70535]: INFO networking_nsxv3.common.synchronization [req-7b5a4046-11d3-41f7-ba41-b7587ad5eb2c req-f2f9f317-717c-4aff-ace0-19de124a3cc7 service nova] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1176.566570] env[70535]: INFO networking_nsxv3.common.synchronization [req-7b5a4046-11d3-41f7-ba41-b7587ad5eb2c req-f2f9f317-717c-4aff-ace0-19de124a3cc7 service nova] Enqueued Resource ID: 9ac50be9-37f9-42ba-8038-f1feebfe9418 with Priority: HIGHEST for action port [ 1176.566809] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_rules [ 1176.566927] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1176.567055] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac50be9-37f9-42ba-8038-f1feebfe9418 with Priority: HIGHEST for action port [ 1176.567615] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.567816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.567816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.568018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.569924] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.570968] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.574144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.574144] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ac50be9-37f9-42ba-8038-f1feebfe9418 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.574144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ac50be9-37f9-42ba-8038-f1feebfe9418" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.574144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ac50be9-37f9-42ba-8038-f1feebfe9418" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.574144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ac50be9-37f9-42ba-8038-f1feebfe9418" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.574144] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ac50be9-37f9-42ba-8038-f1feebfe9418',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.659986] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.660218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.660218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.660890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.660890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.660890] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1176.700034] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.700227] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.700276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.700916] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.700916] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.720087] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1176.801162] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.939378] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.939527] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.939733] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.939951] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.940252] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.940252] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 0490ed55-5e6b-4d4a-a031-6907967ebc4a not found, creating... [ 1176.940501] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.940666] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.940789] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.941028] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.941177] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.941455] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.941759] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.941759] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.941932] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.942086] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.942232] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 0490ed55-5e6b-4d4a-a031-6907967ebc4a is going to be created. [ 1176.964292] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.965121] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.965219] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.965504] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.965782] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.966061] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-0490ed55-5e6b-4d4a-a031-6907967ebc4a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.074111] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.074264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.074401] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ac50be9-37f9-42ba-8038-f1feebfe9418 with status ACTIVE [ 1177.074578] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.074691] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.074758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.074994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.075069] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.075244] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.075343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.075408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.075559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.075638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.075814] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.075912] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.075979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.076146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.076224] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.076309] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ac50be9-37f9-42ba-8038-f1feebfe9418 is going to be updated. [ 1177.114448] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.114690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.114690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.114884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.115038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.115750] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ac50be9-37f9-42ba-8038-f1feebfe9418" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.307625] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.308073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.308161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.308410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.308547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.308654] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e is going to be updated. [ 1177.339537] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.339690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.339690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.339959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.340134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.352661] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e in Status: IN_PROGRESS for 2s [ 1177.550017] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-15 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.550293] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.550485] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.550973] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.551943] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.551943] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.551943] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.551943] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.551943] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.552147] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.552176] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.552292] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.552401] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.552513] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.552629] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.552768] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.575732] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.575922] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.576079] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.576265] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.576829] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-f4cbc254-7c30-4b65-ab11-9fcb91f9bc72 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.576952] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-f4cbc254-7c30-4b65-ab11-9fcb91f9bc72" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.577145] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-f4cbc254-7c30-4b65-ab11-9fcb91f9bc72" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.577664] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-f4cbc254-7c30-4b65-ab11-9fcb91f9bc72" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.577664] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4cbc254-7c30-4b65-ab11-9fcb91f9bc72',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.793468] env[70535]: INFO networking_nsxv3.common.synchronization [req-1ea4d8c3-a8ba-4de2-9c81-8b0099acfa25 req-be27842e-b557-4d44-b7d2-61725b44aa95 service nova] Enqueued Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_rules [ 1177.793646] env[70535]: INFO networking_nsxv3.common.synchronization [req-1ea4d8c3-a8ba-4de2-9c81-8b0099acfa25 req-be27842e-b557-4d44-b7d2-61725b44aa95 service nova] Enqueued Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_members [ 1177.793788] env[70535]: INFO networking_nsxv3.common.synchronization [req-1ea4d8c3-a8ba-4de2-9c81-8b0099acfa25 req-be27842e-b557-4d44-b7d2-61725b44aa95 service nova] Enqueued Resource ID: 0490ed55-5e6b-4d4a-a031-6907967ebc4a with Priority: HIGHEST for action port [ 1177.794035] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_rules [ 1177.794160] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_members [ 1177.794290] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0490ed55-5e6b-4d4a-a031-6907967ebc4a with Priority: HIGHEST for action port [ 1177.794824] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.794879] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.794950] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.795296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.795411] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.796244] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.796388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.796618] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-0490ed55-5e6b-4d4a-a031-6907967ebc4a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.796774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0490ed55-5e6b-4d4a-a031-6907967ebc4a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.796872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0490ed55-5e6b-4d4a-a031-6907967ebc4a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.797088] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0490ed55-5e6b-4d4a-a031-6907967ebc4a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.797199] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0490ed55-5e6b-4d4a-a031-6907967ebc4a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.081574] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.081574] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.081574] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.081812] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.082860] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.082860] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port f4cbc254-7c30-4b65-ab11-9fcb91f9bc72 not found, creating... [ 1178.082860] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.082860] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.082860] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.083198] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.083198] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.083451] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.083643] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.083763] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.083975] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.084147] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.084301] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: f4cbc254-7c30-4b65-ab11-9fcb91f9bc72 is going to be created. [ 1178.113501] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.114155] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.114155] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.114298] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.115120] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.115120] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-f4cbc254-7c30-4b65-ab11-9fcb91f9bc72" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.300124] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.300325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.301607] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0490ed55-5e6b-4d4a-a031-6907967ebc4a with status ACTIVE [ 1178.301795] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.301919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.302015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.302259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.302353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.302555] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.302660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.302723] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.302885] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.302964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.303167] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.303262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.303324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.303463] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.303539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.303624] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0490ed55-5e6b-4d4a-a031-6907967ebc4a is going to be updated. [ 1178.329586] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.330016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.330148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.330502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.330944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.331070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0490ed55-5e6b-4d4a-a031-6907967ebc4a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.460622] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efe16881-900e-4f34-a1b9-20cdccf84a3f in Status: SUCCESS [ 1178.460804] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efe16881-900e-4f34-a1b9-20cdccf84a3f deletion is rescheduled due to dependency. [ 1178.460944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.577401] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1178.577401] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af deletion is rescheduled due to dependency. [ 1178.577401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.577401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.577674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.578042] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.578042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.578042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.578184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.578184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.578346] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.729655] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1178.729922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.080076] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.117867] env[70535]: INFO networking_nsxv3.common.synchronization [req-7b5a4046-11d3-41f7-ba41-b7587ad5eb2c req-0768c142-a3b3-4cbd-99aa-eee64656ef5c service nova] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_rules [ 1179.118177] env[70535]: INFO networking_nsxv3.common.synchronization [req-7b5a4046-11d3-41f7-ba41-b7587ad5eb2c req-0768c142-a3b3-4cbd-99aa-eee64656ef5c service nova] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1179.118435] env[70535]: INFO networking_nsxv3.common.synchronization [req-7b5a4046-11d3-41f7-ba41-b7587ad5eb2c req-0768c142-a3b3-4cbd-99aa-eee64656ef5c service nova] Enqueued Resource ID: f4cbc254-7c30-4b65-ab11-9fcb91f9bc72 with Priority: HIGHEST for action port [ 1179.120295] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_rules [ 1179.120503] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1179.120817] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4cbc254-7c30-4b65-ab11-9fcb91f9bc72 with Priority: HIGHEST for action port [ 1179.121040] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.121184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.121468] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.121581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.121891] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4cbc254-7c30-4b65-ab11-9fcb91f9bc72 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.121973] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4cbc254-7c30-4b65-ab11-9fcb91f9bc72" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.122067] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4cbc254-7c30-4b65-ab11-9fcb91f9bc72" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.122355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4cbc254-7c30-4b65-ab11-9fcb91f9bc72" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.122473] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4cbc254-7c30-4b65-ab11-9fcb91f9bc72',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.129127] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.129320] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.129447] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.129714] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.130016] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.130190] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.130314] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.130907] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.131104] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.131335] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.131459] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.131574] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.131688] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.131804] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.131917] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.132152] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.154853] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.155040] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1179.155186] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.155385] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-592" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.155712] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-006653fe-4618-46c4-86f5-24f60e96ec81 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.155902] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.156183] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.156466] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.156612] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('006653fe-4618-46c4-86f5-24f60e96ec81',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.362899] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e in Status: SUCCESS [ 1179.363267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.363383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.363555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.363908] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.364074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.364154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.364335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.364422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.364522] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.583190] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.626390] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4cbc254-7c30-4b65-ab11-9fcb91f9bc72 with status ACTIVE [ 1179.626390] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.626390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.626390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.626390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.626390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.626631] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.626631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.626631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.627111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.627111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.627239] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.627362] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.627397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.627534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.627615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.627693] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4cbc254-7c30-4b65-ab11-9fcb91f9bc72 is going to be updated. [ 1179.651307] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.651495] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.651605] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.651986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.651986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.652171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4cbc254-7c30-4b65-ab11-9fcb91f9bc72" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.659634] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.659634] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.659874] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.660230] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.660310] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.660627] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.660827] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.660978] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.661269] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.661445] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.661821] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.661959] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.662165] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.662514] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.662514] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.662687] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 006653fe-4618-46c4-86f5-24f60e96ec81 is going to be updated. [ 1179.692724] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.692941] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.693086] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.693437] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.693644] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.693866] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.866455] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.085577] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.085657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.085691] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.086015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.086015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.086083] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1180.122257] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.122481] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.122612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.122874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.123086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.133919] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1180.369497] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.475383] env[70535]: INFO networking_nsxv3.common.synchronization [req-cc318a7b-bce4-42ee-b94d-70997db5cba0 req-cc77689d-d6f4-4c23-a78d-824298875800 service nova] Enqueued Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_rules [ 1180.475634] env[70535]: INFO networking_nsxv3.common.synchronization [req-cc318a7b-bce4-42ee-b94d-70997db5cba0 req-cc77689d-d6f4-4c23-a78d-824298875800 service nova] Enqueued Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_members [ 1180.475788] env[70535]: INFO networking_nsxv3.common.synchronization [req-cc318a7b-bce4-42ee-b94d-70997db5cba0 req-cc77689d-d6f4-4c23-a78d-824298875800 service nova] Enqueued Resource ID: 006653fe-4618-46c4-86f5-24f60e96ec81 with Priority: HIGHEST for action port [ 1180.476111] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_rules [ 1180.476239] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_members [ 1180.476394] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 006653fe-4618-46c4-86f5-24f60e96ec81 with Priority: HIGHEST for action port [ 1180.476942] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76787551-efbb-4eb5-bef3-77685e9cde96 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.477653] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.478977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.479248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.479336] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.480196] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-76787551-efbb-4eb5-bef3-77685e9cde96 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.480315] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.480382] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.480569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.480720] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.480814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.481711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.481711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.481711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.481711] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.481966] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-006653fe-4618-46c4-86f5-24f60e96ec81 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.482390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.482390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.482390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.482390] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('006653fe-4618-46c4-86f5-24f60e96ec81',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.872506] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.872715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.872715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.872895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.872989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.873105] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e is going to be updated. [ 1180.905815] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.906063] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.906063] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.906260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.906409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.930793] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e in Status: IN_PROGRESS for 2s [ 1180.984613] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.985796] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-76787551-efbb-4eb5-bef3-77685e9cde96 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.985942] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.986138] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 006653fe-4618-46c4-86f5-24f60e96ec81 with status ACTIVE [ 1180.986310] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.986452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.986512] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.986735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.986827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.987152] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.987152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.987244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.987369] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.987462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.987626] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.987722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.987793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.987914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.987966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.988071] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 006653fe-4618-46c4-86f5-24f60e96ec81 is going to be updated. [ 1181.022028] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.022224] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.022263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.022471] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.022610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.023046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-006653fe-4618-46c4-86f5-24f60e96ec81" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.490300] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.916863] env[70535]: INFO networking_nsxv3.common.synchronization [req-a971e3f5-f817-48b8-b53b-e582732a6fe2 req-c55aa8e8-06c3-4595-b129-25ea04514e6c tempest-ServerActionsTestJSON-1674828100 tempest-ServerActionsTestJSON-1674828100-project-member] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 1181.917439] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 1181.917756] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.917876] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.917943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.918159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.918315] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.918422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.918490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.918613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.918692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.918822] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.994218] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.994442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.995209] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.995502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.995607] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.995730] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76787551-efbb-4eb5-bef3-77685e9cde96 is going to be updated. [ 1182.032304] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.032446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.032503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.032736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.032879] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.042884] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76787551-efbb-4eb5-bef3-77685e9cde96 in Status: IN_PROGRESS for 2s [ 1182.147940] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1182.148295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.148543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.149388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.149654] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.149835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.149959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.150195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.150322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.150631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.150631] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.151757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.152106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.155884] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.155884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.155884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.155884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.155884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.155884] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.323545] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.323756] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.323889] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.324214] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.324529] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.324682] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.324806] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.325066] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.325224] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.325454] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1182.325596] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1182.325784] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1182.325924] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1182.326073] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1182.326194] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1182.326340] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1182.350878] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1182.351172] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1182.351275] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1182.351480] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.351831] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-fcfc54ce-bba4-483d-9338-d22a47e0a0e3 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.352041] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-fcfc54ce-bba4-483d-9338-d22a47e0a0e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.352242] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-fcfc54ce-bba4-483d-9338-d22a47e0a0e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.352635] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-fcfc54ce-bba4-483d-9338-d22a47e0a0e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.352840] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcfc54ce-bba4-483d-9338-d22a47e0a0e3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.421089] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.421335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.421437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.421657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.421747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.422042] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.422423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.422423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.422733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.422793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.422985] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 is going to be updated. [ 1182.453118] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.453302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.453518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.453756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.454038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.466104] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: IN_PROGRESS for 2s [ 1182.656157] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.656491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.657788] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.856012] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.856282] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.856419] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.856723] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.856912] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.857087] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port fcfc54ce-bba4-483d-9338-d22a47e0a0e3 not found, creating... [ 1182.857367] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.857654] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.857654] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.857873] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.858020] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.858312] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.858476] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.858601] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.858855] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.859033] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.859149] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: fcfc54ce-bba4-483d-9338-d22a47e0a0e3 is going to be created. [ 1182.881634] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.881634] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.881634] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.881950] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.882157] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.882966] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-fcfc54ce-bba4-483d-9338-d22a47e0a0e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.950722] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e in Status: SUCCESS [ 1182.950722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.950965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.951238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.951448] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.951568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.951636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.951797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.951881] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.951968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.952069] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.161935] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.454371] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.454524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.454595] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.454803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.454957] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.455067] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.455129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.455270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.455352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.455436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.455573] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.455658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.455825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.455971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.456118] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.456206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.456263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.456394] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.456463] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.456541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.456625] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.658556] env[70535]: INFO networking_nsxv3.common.synchronization [req-a971e3f5-f817-48b8-b53b-e582732a6fe2 req-45c78c73-3b18-4fc9-9e6b-9a2cbdf2bfd6 service nova] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_rules [ 1183.658869] env[70535]: INFO networking_nsxv3.common.synchronization [req-a971e3f5-f817-48b8-b53b-e582732a6fe2 req-45c78c73-3b18-4fc9-9e6b-9a2cbdf2bfd6 service nova] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 1183.658995] env[70535]: INFO networking_nsxv3.common.synchronization [req-a971e3f5-f817-48b8-b53b-e582732a6fe2 req-45c78c73-3b18-4fc9-9e6b-9a2cbdf2bfd6 service nova] Enqueued Resource ID: fcfc54ce-bba4-483d-9338-d22a47e0a0e3 with Priority: HIGHEST for action port [ 1183.659347] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_rules [ 1183.659553] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 1183.659716] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcfc54ce-bba4-483d-9338-d22a47e0a0e3 with Priority: HIGHEST for action port [ 1183.660447] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.660582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.660678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.660849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.660929] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.661851] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.661996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.662234] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcfc54ce-bba4-483d-9338-d22a47e0a0e3 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.662234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcfc54ce-bba4-483d-9338-d22a47e0a0e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.662395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcfc54ce-bba4-483d-9338-d22a47e0a0e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.662454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcfc54ce-bba4-483d-9338-d22a47e0a0e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.662518] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcfc54ce-bba4-483d-9338-d22a47e0a0e3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.663818] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.663818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.663923] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.664329] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.664329] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.664329] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1183.693866] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.693866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.693866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.693866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.693866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.705096] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1183.959191] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1cf765d-0bda-40d5-92f0-076a8eeca55e: rpc.has_security_group_logging(os_id): False [ 1183.979591] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.979833] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.979833] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.980261] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.980261] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.980397] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.980397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.980512] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.980606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.980684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.980861] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.980986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.981047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.981184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.981266] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.981458] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.981554] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.981613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.981753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.981896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.981988] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e is going to be updated. [ 1184.053637] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.053872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.053984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.054323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.054550] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.057073] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76787551-efbb-4eb5-bef3-77685e9cde96 in Status: SUCCESS [ 1184.057355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.058077] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.058384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.058683] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.058873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.058981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.059255] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.059393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.059543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.059694] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.073800] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e in Status: IN_PROGRESS for 2s [ 1184.164580] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.164775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.166262] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcfc54ce-bba4-483d-9338-d22a47e0a0e3 with status ACTIVE [ 1184.166582] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.166792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.166898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.167237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.167429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.167688] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.167827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.168014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.168183] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.168304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.168578] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.168725] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.168851] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.169182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.169343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.169481] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcfc54ce-bba4-483d-9338-d22a47e0a0e3 is going to be updated. [ 1184.221379] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.221379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.221379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.221379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.221379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.221379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcfc54ce-bba4-483d-9338-d22a47e0a0e3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.480330] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: SUCCESS [ 1184.480330] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 deletion is rescheduled due to dependency. [ 1184.480330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.480330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.480568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.480786] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.480927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.481032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.481460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.481594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.481700] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.562512] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.984249] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.065669] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76787551-efbb-4eb5-bef3-77685e9cde96: rpc.has_security_group_logging(os_id): False [ 1185.085259] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.085342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.085411] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.085704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.117321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.117321] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.117321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.117321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.117321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.117321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.117321] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76787551-efbb-4eb5-bef3-77685e9cde96 is going to be updated. [ 1185.177989] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.178141] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.178141] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.180065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.180320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.213010] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76787551-efbb-4eb5-bef3-77685e9cde96 in Status: IN_PROGRESS for 2s [ 1185.489616] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.723520] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1185.724695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.724695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.724954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.725415] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.727367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.727367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.727367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.727367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.727367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.727367] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.727781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.727781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.728638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.728638] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.729066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.729066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.729344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.729558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.729792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.730035] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.995838] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.995838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.995838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.995838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.995838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.995838] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 is going to be updated. [ 1186.041845] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.042105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.042292] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.042565] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.042803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.056068] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: IN_PROGRESS for 2s [ 1186.101968] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e in Status: SUCCESS [ 1186.102304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.236377] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 461f32c9-3471-46f7-8f0a-362b6fb196af: rpc.has_security_group_logging(os_id): False [ 1186.258644] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.258644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.258644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.258644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.258914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.259373] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.259373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.259373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.259373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.259651] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.259651] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.259734] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.259801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.259991] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.260094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.260313] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.260407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.260466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.260609] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.260684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.260769] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1186.355312] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.355574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.355574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.356136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.356136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.374556] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1187.210928] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.211316] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.211495] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.211821] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.212157] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.212391] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.212585] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.212851] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.213017] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.213243] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.213365] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.213480] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.213590] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.213715] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.213825] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.214222] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.243846] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76787551-efbb-4eb5-bef3-77685e9cde96 in Status: SUCCESS [ 1187.244223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.245063] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.245423] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1187.245423] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.245542] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-547" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.245855] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-6daf8085-f101-435b-b6f1-8f054b068aa9 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.246072] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.246216] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.246624] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.246869] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6daf8085-f101-435b-b6f1-8f054b068aa9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.750126] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.750474] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.750661] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.751724] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.751724] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.751724] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.752046] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.752046] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.752185] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.752332] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.752637] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.752794] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.752915] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.753159] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.753293] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.753818] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 6daf8085-f101-435b-b6f1-8f054b068aa9 is going to be updated. [ 1187.777925] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.778348] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.779565] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.779565] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.779565] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.779565] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.068210] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: SUCCESS [ 1188.068433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.068619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.068892] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.069128] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.069289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.070129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.070129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.070129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.070129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.070129] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.397816] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1188.397816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.397816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.397816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.397816] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.565749] env[70535]: INFO networking_nsxv3.common.synchronization [req-4aa17074-b96a-4218-b1f9-68193947627f req-24878c85-feb4-460e-9358-1ca2d76b4eb5 service nova] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_rules [ 1188.565985] env[70535]: INFO networking_nsxv3.common.synchronization [req-4aa17074-b96a-4218-b1f9-68193947627f req-24878c85-feb4-460e-9358-1ca2d76b4eb5 service nova] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1188.566238] env[70535]: INFO networking_nsxv3.common.synchronization [req-4aa17074-b96a-4218-b1f9-68193947627f req-24878c85-feb4-460e-9358-1ca2d76b4eb5 service nova] Enqueued Resource ID: 6daf8085-f101-435b-b6f1-8f054b068aa9 with Priority: HIGHEST for action port [ 1188.566942] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_rules [ 1188.567198] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1188.567347] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6daf8085-f101-435b-b6f1-8f054b068aa9 with Priority: HIGHEST for action port [ 1188.567681] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.567841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.567956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.568219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.568396] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.569913] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.570129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.570334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.571033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.573872] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.573872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.573872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.573872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.573872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.573872] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.573872] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-6daf8085-f101-435b-b6f1-8f054b068aa9 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.573872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.574388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.574545] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.574714] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6daf8085-f101-435b-b6f1-8f054b068aa9',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.576923] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.900459] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.900669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.900747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.900999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.901164] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.901565] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.902024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.902024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.902024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.902189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.902189] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.075033] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.077689] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6daf8085-f101-435b-b6f1-8f054b068aa9 with status ACTIVE [ 1189.077859] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.078089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.078089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.078285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.078371] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.078697] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.078831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.078937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.079129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.079217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.079409] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.079507] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.079626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.079915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.080015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.080137] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6daf8085-f101-435b-b6f1-8f054b068aa9 is going to be updated. [ 1189.081495] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.081594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.081823] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d004720e-0079-4896-920b-7b1e57b6b7b8: rpc.has_security_group_logging(os_id): False [ 1189.117437] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.117686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.117686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.117862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.117957] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.118369] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.118490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.118538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.118661] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.118740] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.118950] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 is going to be updated. [ 1189.122680] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.122812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.122884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.123081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.123229] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.123833] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6daf8085-f101-435b-b6f1-8f054b068aa9" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.197075] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.197075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.197461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.198065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.198228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.232350] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: IN_PROGRESS for 2s [ 1189.405603] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.405603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.406036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.406078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.406353] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.406499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.406595] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.407123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.407123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.407123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.407282] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.407332] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.407406] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.407646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.409501] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.409501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.409501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.409501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.409501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.409501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.409501] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.577543] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.912158] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 461f32c9-3471-46f7-8f0a-362b6fb196af: rpc.has_security_group_logging(os_id): False [ 1189.936456] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.936795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.936881] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.939093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.939093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.939093] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.939093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.939093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.939093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.939093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.939093] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.939093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.939093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.939749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.939749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.940331] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.940331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.940331] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.940533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.940692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.940824] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1190.058104] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.058330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.058330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.059134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.059134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.074669] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1190.080387] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.080578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.080578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.080781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.080871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.081045] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be updated. [ 1190.118374] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.118567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.118567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.118792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.118973] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.129758] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: IN_PROGRESS for 2s [ 1190.795538] env[70535]: INFO networking_nsxv3.common.synchronization [req-f18b8d2e-5c27-4962-99db-6942a168890b req-31124a40-1d01-40fd-8476-0ee6f9658753 tempest-DeleteServersTestJSON-660883378 tempest-DeleteServersTestJSON-660883378-project-member] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1190.796241] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1190.796640] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.797208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.797208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.797208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.797208] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.797395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.797426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.797772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.797772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.797772] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.247363] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: SUCCESS [ 1191.247651] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.300441] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.300715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.300796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.301080] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.301248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.301538] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.301688] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.301784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.302053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.302179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.302313] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1191.337553] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.337734] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.337784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.337988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.338265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.348150] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1192.094897] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1192.095281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.143111] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 1192.143333] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.143505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.143728] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.143930] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.144118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.144186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.144360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.144439] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.144526] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.144615] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.647390] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.647613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.647645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.648217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.648217] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.648359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.648359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.648529] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.648657] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.648778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.649009] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.649122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.649188] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.649731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.649731] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.649731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.649731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.649963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.649963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.649963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.650102] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.152907] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63056e22-45eb-4c1b-b65b-578fb5876c5b: rpc.has_security_group_logging(os_id): False [ 1193.182903] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.183218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.183218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.183828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.183828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.183828] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.183828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.184088] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.184505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.184611] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.185541] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.185541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.185541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.185541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.185541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.185875] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.185875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.185875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.186020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.186079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.186115] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be updated. [ 1193.489703] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1193.490117] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f deletion is rescheduled due to dependency. [ 1193.490117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.517765] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.518057] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.518057] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.518233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.518361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.536595] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: IN_PROGRESS for 2s [ 1194.763163] env[70535]: INFO networking_nsxv3.common.synchronization [req-c5c08787-e011-4922-ac73-2362cef5a06d req-a589b94e-e0f5-4012-b160-6ba67f9c1ffa tempest-ListServerFiltersTestJSON-136218615 tempest-ListServerFiltersTestJSON-136218615-project-member] Enqueued Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1194.765940] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGHEST for action security_group_members [ 1194.766823] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.766823] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.766823] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.767394] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.768240] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.768418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.768569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.769059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.769629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.769767] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.235705] env[70535]: INFO networking_nsxv3.common.synchronization [req-e1725c07-636f-4e5f-9652-2e0d86541b4d req-e684b1ba-abeb-4f93-aa2b-acba9447f80f tempest-ServersTestMultiNic-1028446262 tempest-ServersTestMultiNic-1028446262-project-member] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1195.236251] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1195.236573] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.236699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.236766] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.236977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.237820] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.238048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.238176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.238385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.238710] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.238853] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.271738] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.271892] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.271964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.272227] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.272324] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.272520] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.272623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.272685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.272856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.272934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.273048] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e is going to be updated. [ 1195.302982] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.303151] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.303230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.303533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.303704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.314386] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: IN_PROGRESS for 2s [ 1195.445778] env[70535]: INFO networking_nsxv3.common.synchronization [req-e1725c07-636f-4e5f-9652-2e0d86541b4d req-c442a5c6-a0ac-4c0d-b78c-bc47ec029fae tempest-ServersTestMultiNic-1028446262 tempest-ServersTestMultiNic-1028446262-project-member] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1195.447505] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGHEST for action security_group_members [ 1195.449042] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.449221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.558319] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 1195.558567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.744467] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.247606] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.750690] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.750690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.750690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.750941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.750941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.750997] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1196.793059] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.793059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.793059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.793330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.793330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.808851] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1197.326890] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e in Status: SUCCESS [ 1197.327205] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e deletion is rescheduled due to dependency. [ 1197.328640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.407595] env[70535]: INFO networking_nsxv3.common.synchronization [req-f2d1a60d-5139-4cdc-a738-715433b73211 req-cdb7368d-acfe-4afe-9ca7-c38ffa20aaeb tempest-ServersNegativeTestMultiTenantJSON-1361376360 tempest-ServersNegativeTestMultiTenantJSON-1361376360-project-member] Enqueued Resource ID: e09d60b0-1676-48ff-9de4-486b63636b40 with Priority: HIGHEST for action security_group_members [ 1197.407595] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09d60b0-1676-48ff-9de4-486b63636b40 with Priority: HIGHEST for action security_group_members [ 1197.407595] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09d60b0-1676-48ff-9de4-486b63636b40 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.407595] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.407595] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.407595] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.407962] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.407962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.407962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.407962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.408209] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.408209] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e09d60b0-1676-48ff-9de4-486b63636b40',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.909982] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.910174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.910242] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.910460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.910546] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.910746] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.910859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.910901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.911060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.911135] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.911219] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e09d60b0-1676-48ff-9de4-486b63636b40 already deleted. [ 1197.911311] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.008898] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.008898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-681" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.008898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-681" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.008898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-681" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.008898] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.008898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.008898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.008898] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.010936] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.010936] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1198.011058] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.011176] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.011289] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.011429] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1198.011656] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.011699] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.033585] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.033842] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1198.033931] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.034146] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-681" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.034506] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-31a1fcba-6d2a-415e-9598-aa6e1143036a taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.034698] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-31a1fcba-6d2a-415e-9598-aa6e1143036a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.034825] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-31a1fcba-6d2a-415e-9598-aa6e1143036a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.035220] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-31a1fcba-6d2a-415e-9598-aa6e1143036a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.039054] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a1fcba-6d2a-415e-9598-aa6e1143036a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.538583] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.538884] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.538971] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.539305] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.539482] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.539645] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 31a1fcba-6d2a-415e-9598-aa6e1143036a not found, creating... [ 1198.539915] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.540130] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.540262] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.540493] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.540640] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.540968] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.541721] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.541721] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.541840] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.541994] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.542184] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 31a1fcba-6d2a-415e-9598-aa6e1143036a is going to be created. [ 1198.564874] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.565096] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.565181] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.565474] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.565725] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.565955] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-31a1fcba-6d2a-415e-9598-aa6e1143036a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.821231] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1198.821511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.821703] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.821982] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.822240] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.822388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.822473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.822666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.822772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.822893] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.325531] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.325771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.325771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.325934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.326036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.326302] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.326387] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.326448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.326606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.326682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.326770] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be updated. [ 1199.358912] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.359180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.359290] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.359491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.359638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.369259] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: IN_PROGRESS for 2s [ 1199.837372] env[70535]: INFO networking_nsxv3.common.synchronization [req-f2d1a60d-5139-4cdc-a738-715433b73211 req-74cd50fd-c7cd-44f2-be12-a475459db87e service nova] Enqueued Resource ID: e09d60b0-1676-48ff-9de4-486b63636b40 with Priority: HIGHEST for action security_group_rules [ 1199.837623] env[70535]: INFO networking_nsxv3.common.synchronization [req-f2d1a60d-5139-4cdc-a738-715433b73211 req-74cd50fd-c7cd-44f2-be12-a475459db87e service nova] Enqueued Resource ID: e09d60b0-1676-48ff-9de4-486b63636b40 with Priority: HIGHEST for action security_group_members [ 1199.837792] env[70535]: INFO networking_nsxv3.common.synchronization [req-f2d1a60d-5139-4cdc-a738-715433b73211 req-74cd50fd-c7cd-44f2-be12-a475459db87e service nova] Enqueued Resource ID: 31a1fcba-6d2a-415e-9598-aa6e1143036a with Priority: HIGHEST for action port [ 1199.837970] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09d60b0-1676-48ff-9de4-486b63636b40 with Priority: HIGHEST for action security_group_rules [ 1199.838131] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09d60b0-1676-48ff-9de4-486b63636b40 with Priority: HIGHEST for action security_group_members [ 1199.838228] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a1fcba-6d2a-415e-9598-aa6e1143036a with Priority: HIGHEST for action port [ 1199.838777] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e09d60b0-1676-48ff-9de4-486b63636b40 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.838901] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.838966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.839342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.839432] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e09d60b0-1676-48ff-9de4-486b63636b40',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.840264] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09d60b0-1676-48ff-9de4-486b63636b40 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.840617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.840617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.840617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.840761] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.840878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.840878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.841027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.841190] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.841294] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e09d60b0-1676-48ff-9de4-486b63636b40',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.842322] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-31a1fcba-6d2a-415e-9598-aa6e1143036a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.842425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31a1fcba-6d2a-415e-9598-aa6e1143036a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.842491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31a1fcba-6d2a-415e-9598-aa6e1143036a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.843163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31a1fcba-6d2a-415e-9598-aa6e1143036a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.843163] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a1fcba-6d2a-415e-9598-aa6e1143036a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.344809] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e09d60b0-1676-48ff-9de4-486b63636b40',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.346409] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09d60b0-1676-48ff-9de4-486b63636b40 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.346641] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.346756] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31a1fcba-6d2a-415e-9598-aa6e1143036a with status ACTIVE [ 1200.346983] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.347149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.347216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.347602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.347602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.347803] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.347933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.348026] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.348199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.348311] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.348564] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.348679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.348754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.348922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.349052] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.349158] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31a1fcba-6d2a-415e-9598-aa6e1143036a is going to be updated. [ 1200.376792] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.377099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.377193] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.377502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.377727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.377997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31a1fcba-6d2a-415e-9598-aa6e1143036a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.851635] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e09d60b0-1676-48ff-9de4-486b63636b40',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.030839] env[70535]: INFO networking_nsxv3.common.synchronization [req-2dc2c680-74db-4716-93f5-42f65dfe6a0a req-91ed7c55-f542-43e8-b2f6-aa2052a7a349 tempest-ServerActionsTestOtherB-1362861695 tempest-ServerActionsTestOtherB-1362861695-project-member] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1201.031460] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1201.031762] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.031907] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.031976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.032250] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.032418] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.032521] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.032584] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.032733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.032921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.033382] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.353996] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.354452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.354544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.354768] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.354863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.354967] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e09d60b0-1676-48ff-9de4-486b63636b40 is going to be created. [ 1201.383256] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.383435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.383477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.384043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.384043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.386895] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 461f32c9-3471-46f7-8f0a-362b6fb196af in Status: SUCCESS [ 1201.387140] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af deletion is rescheduled due to dependency. [ 1201.387276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.396109] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09d60b0-1676-48ff-9de4-486b63636b40 in Status: UNINITIALIZED for 2s [ 1201.535156] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.535306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.535373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.535600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.535689] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.535885] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.535979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.536050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.536206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.536915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.536915] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be updated. [ 1201.571363] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.571518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.571558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.571772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.571903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.583461] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: IN_PROGRESS for 2s [ 1203.407581] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09d60b0-1676-48ff-9de4-486b63636b40 in Status: SUCCESS [ 1203.407894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.407969] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.408224] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.408418] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.408531] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.408606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.408758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.408840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.408925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.409028] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e09d60b0-1676-48ff-9de4-486b63636b40',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.596390] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 1203.596689] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c deletion is rescheduled due to dependency. [ 1203.596925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.840393] env[70535]: INFO networking_nsxv3.common.synchronization [req-2ce1369c-4024-454a-be10-cc15081e2d37 req-14ab3c94-0162-499c-8495-cf7d66487e31 tempest-DeleteServersTestJSON-660883378 tempest-DeleteServersTestJSON-660883378-project-member] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1203.840924] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1203.840924] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.841138] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.841253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.841435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.841708] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.842244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.842244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.842244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.842244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.842244] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.912414] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09d60b0-1676-48ff-9de4-486b63636b40 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.912638] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.912724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.913078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.913303] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.913469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.913568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.913705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.913818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.913964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.914247] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09d60b0-1676-48ff-9de4-486b63636b40 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.914389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.914493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.914792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.914916] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.915069] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.915145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.915296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.915414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.915541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.915717] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e09d60b0-1676-48ff-9de4-486b63636b40',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.345272] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.345528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.345590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.345863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.345965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.346206] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.346307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.346400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.346563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.346644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.346735] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1204.351130] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.351377] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.351515] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.351783] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.352088] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.352284] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.352370] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.352598] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.352739] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.352956] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1204.353089] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1204.353208] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1204.353322] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1204.353431] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1204.353543] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1204.353677] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1204.376983] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1204.377250] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1204.377349] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1204.377506] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.377837] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-9766f855-9197-4d64-bad6-a4684ed6ebd7 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.378027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-9766f855-9197-4d64-bad6-a4684ed6ebd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.378149] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-9766f855-9197-4d64-bad6-a4684ed6ebd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.378511] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-9766f855-9197-4d64-bad6-a4684ed6ebd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.378657] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9766f855-9197-4d64-bad6-a4684ed6ebd7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.387945] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.388408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.388500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.388703] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.388846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.400763] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1204.418957] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e09d60b0-1676-48ff-9de4-486b63636b40: rpc.has_security_group_logging(os_id): False [ 1204.439013] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.439295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.439367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.439589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.439700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.439908] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.440016] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.440186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.440368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.440453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.440686] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.440784] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.440913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.441076] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.441250] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.441632] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.441749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.441801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.442034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.442645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.442955] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e09d60b0-1676-48ff-9de4-486b63636b40 is going to be created. [ 1204.532999] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.533237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.533237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.534036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.534036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.549540] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e09d60b0-1676-48ff-9de4-486b63636b40 in Status: IN_PROGRESS for 2s [ 1204.881225] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.881450] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.881563] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.881855] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.882025] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.882190] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 9766f855-9197-4d64-bad6-a4684ed6ebd7 not found, creating... [ 1204.882521] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.882691] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.882831] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.883053] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.883204] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.883491] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.883674] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.883797] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.884027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.884173] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.884319] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 9766f855-9197-4d64-bad6-a4684ed6ebd7 is going to be created. [ 1204.905845] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.906116] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.906203] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.906527] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.906802] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.907049] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-9766f855-9197-4d64-bad6-a4684ed6ebd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.962105] env[70535]: INFO networking_nsxv3.common.synchronization [req-2ce1369c-4024-454a-be10-cc15081e2d37 req-a3345c36-7922-42a0-8b58-16997512a847 service nova] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_rules [ 1205.962571] env[70535]: INFO networking_nsxv3.common.synchronization [req-2ce1369c-4024-454a-be10-cc15081e2d37 req-a3345c36-7922-42a0-8b58-16997512a847 service nova] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1205.962571] env[70535]: INFO networking_nsxv3.common.synchronization [req-2ce1369c-4024-454a-be10-cc15081e2d37 req-a3345c36-7922-42a0-8b58-16997512a847 service nova] Enqueued Resource ID: 9766f855-9197-4d64-bad6-a4684ed6ebd7 with Priority: HIGHEST for action port [ 1205.962846] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_rules [ 1205.962846] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1205.962934] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9766f855-9197-4d64-bad6-a4684ed6ebd7 with Priority: HIGHEST for action port [ 1205.963703] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.963838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.963904] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.964124] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.964208] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.965046] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.965147] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.965347] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-9766f855-9197-4d64-bad6-a4684ed6ebd7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.965454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9766f855-9197-4d64-bad6-a4684ed6ebd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.965513] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9766f855-9197-4d64-bad6-a4684ed6ebd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.965679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9766f855-9197-4d64-bad6-a4684ed6ebd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.965753] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9766f855-9197-4d64-bad6-a4684ed6ebd7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.028619] env[70535]: INFO networking_nsxv3.common.synchronization [req-985fdc35-57e4-4427-8fe0-e0039e164e5b req-f9128978-fe82-4696-885b-f59902a0cb51 tempest-ServerRescueTestJSON-1736721769 tempest-ServerRescueTestJSON-1736721769-project-member] Enqueued Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_members [ 1206.029811] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_members [ 1206.030192] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.030341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.030416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.030665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.030832] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.030954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.031032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.031211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.031312] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.031412] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.414500] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1206.418023] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f deletion is rescheduled due to dependency. [ 1206.418023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.418023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.418023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.418023] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.418023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.418023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.418023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.418023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.418757] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.468225] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.468874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.473024] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9766f855-9197-4d64-bad6-a4684ed6ebd7 with status ACTIVE [ 1206.473024] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.473024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.473024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.473024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.473024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.473024] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.473024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.473024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.473024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.473024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.473024] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.473024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.473024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.473024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.473024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.473024] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9766f855-9197-4d64-bad6-a4684ed6ebd7 is going to be updated. [ 1206.500974] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.500974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.500974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.500974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.500974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.500974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9766f855-9197-4d64-bad6-a4684ed6ebd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.534780] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.563870] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e09d60b0-1676-48ff-9de4-486b63636b40 in Status: SUCCESS [ 1206.563870] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.677341] env[70535]: INFO networking_nsxv3.common.synchronization [req-3b55583b-6a19-4bf7-a9d2-4ae94bb0becd req-0b4c50f8-718e-4aa1-b2bc-5e07601ac6cd tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_members [ 1206.678261] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_members [ 1206.678601] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f11229e-4f65-4aab-a492-ad9dd37f60f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.678738] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.678821] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.679153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.679387] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.679511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.679586] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.679796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.679892] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.680606] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.920663] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.036340] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.183922] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.423253] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.538953] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.539203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.539289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.539632] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.539632] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.539791] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e is going to be updated. [ 1207.585231] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.585412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.585483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.585700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.585846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.596272] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e in Status: IN_PROGRESS for 2s [ 1207.687898] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.925441] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.925678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.925873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.926139] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.926364] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.926474] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1207.965061] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.965242] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.965288] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.965495] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.965649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.975719] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1208.191239] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.191584] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.191584] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.193018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.193018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.193018] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 is going to be updated. [ 1208.228405] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.228405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.228405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.228405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.228405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.238459] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 in Status: IN_PROGRESS for 2s [ 1209.607310] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e in Status: SUCCESS [ 1209.607721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.988025] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1209.988254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.988468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.988704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.988907] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.989051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.989130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.989325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.989509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.989509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.989706] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.252220] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 in Status: SUCCESS [ 1210.252220] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.495107] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.495107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.495107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.495107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.495107] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.495107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.495107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.495107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.495107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.495107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.495107] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.495107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.495107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.495107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.495107] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.496098] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.496212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.496390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.496566] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.496698] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.496766] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.625859] env[70535]: INFO networking_nsxv3.common.synchronization [req-1b4e533a-a5ed-4449-a154-d42ea816a825 req-55ed2a29-a6cb-4c6e-be2d-ea96b1fc0aba tempest-ServersTestJSON-886254797 tempest-ServersTestJSON-886254797-project-member] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1210.626503] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1210.626826] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.627602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.627602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.627602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.627602] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.627602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.627602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.627868] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.627868] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.627868] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.998883] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9eeea75-d1ec-4e08-9721-eccdc9dae25f: rpc.has_security_group_logging(os_id): False [ 1211.019582] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.020499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.020606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.020841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.020946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.021219] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.021333] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.021411] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.021579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.021656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.021862] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.021962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.022039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.022186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.022262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.022455] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.022552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.022613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.022755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.022834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.022921] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1211.101969] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.102361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.102361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.102644] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.102835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.121913] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1211.132848] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.180024] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.180326] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.181031] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.181031] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.181031] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.181244] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.181577] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.181843] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.182086] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.184014] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1211.184014] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1211.184014] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1211.184014] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1211.184014] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1211.184014] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1211.184014] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1211.238448] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1211.238686] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.055 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1211.238816] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1211.239261] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.239755] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-dde9e57d-f051-4636-9602-1816abd7a20a taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.239986] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-dde9e57d-f051-4636-9602-1816abd7a20a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.240134] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-dde9e57d-f051-4636-9602-1816abd7a20a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.240572] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-dde9e57d-f051-4636-9602-1816abd7a20a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.241665] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde9e57d-f051-4636-9602-1816abd7a20a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.635637] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.744209] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.744449] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.744657] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.745540] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.745782] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.746015] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port dde9e57d-f051-4636-9602-1816abd7a20a not found, creating... [ 1211.746326] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.747222] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.747392] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.747694] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.747857] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.748902] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.748902] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.748902] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.748902] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.748902] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.749109] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: dde9e57d-f051-4636-9602-1816abd7a20a is going to be created. [ 1211.772815] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.773053] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.773185] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.773468] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.773707] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.773933] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-dde9e57d-f051-4636-9602-1816abd7a20a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.893081] env[70535]: INFO networking_nsxv3.common.synchronization [req-c336663a-75be-4902-86a8-0e99dc8a10b3 req-62683076-df2f-4ea0-953f-bfb9a76c4388 tempest-ServersNegativeTestMultiTenantJSON-1361376360 tempest-ServersNegativeTestMultiTenantJSON-1361376360-project-member] Enqueued Resource ID: e09d60b0-1676-48ff-9de4-486b63636b40 with Priority: HIGHEST for action security_group_members [ 1211.893727] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09d60b0-1676-48ff-9de4-486b63636b40 with Priority: HIGHEST for action security_group_members [ 1211.894209] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-e09d60b0-1676-48ff-9de4-486b63636b40 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.894401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.894513] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.894815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.895063] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.895222] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.895319] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.895555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.895690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.895830] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e09d60b0-1676-48ff-9de4-486b63636b40',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.138193] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.138319] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.138393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.138620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.138713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.138817] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1212.194825] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.195171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.195171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.195935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.195935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.204729] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1212.397911] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.398173] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.398173] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.398444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.398568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.398772] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.398883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.398948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.399123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.399226] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.399338] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e09d60b0-1676-48ff-9de4-486b63636b40 is going to be updated. [ 1212.429728] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.429914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.429914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.431262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.431262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.434161] env[70535]: INFO networking_nsxv3.common.synchronization [req-1b4e533a-a5ed-4449-a154-d42ea816a825 req-5dc76877-a6c3-4ff3-91d7-8ffa2dac0ffc service nova] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_rules [ 1212.434161] env[70535]: INFO networking_nsxv3.common.synchronization [req-1b4e533a-a5ed-4449-a154-d42ea816a825 req-5dc76877-a6c3-4ff3-91d7-8ffa2dac0ffc service nova] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1212.434161] env[70535]: INFO networking_nsxv3.common.synchronization [req-1b4e533a-a5ed-4449-a154-d42ea816a825 req-5dc76877-a6c3-4ff3-91d7-8ffa2dac0ffc service nova] Enqueued Resource ID: dde9e57d-f051-4636-9602-1816abd7a20a with Priority: HIGHEST for action port [ 1212.434435] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_rules [ 1212.434435] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1212.434435] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dde9e57d-f051-4636-9602-1816abd7a20a with Priority: HIGHEST for action port [ 1212.434693] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.434857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.434857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.435066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.435153] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.436274] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.436388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.436566] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-dde9e57d-f051-4636-9602-1816abd7a20a taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.436666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dde9e57d-f051-4636-9602-1816abd7a20a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.436722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dde9e57d-f051-4636-9602-1816abd7a20a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.436897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dde9e57d-f051-4636-9602-1816abd7a20a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.436973] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde9e57d-f051-4636-9602-1816abd7a20a',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.441062] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09d60b0-1676-48ff-9de4-486b63636b40 in Status: IN_PROGRESS for 2s [ 1212.939091] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.939646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.939646] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dde9e57d-f051-4636-9602-1816abd7a20a with status ACTIVE [ 1212.939646] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.939770] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.939830] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.939998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.940097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.940270] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.940381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.940421] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.940585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.940673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.940906] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.941051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.941139] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.941460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.941460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.941539] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dde9e57d-f051-4636-9602-1816abd7a20a is going to be updated. [ 1212.964473] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.964791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.964890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.965117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.965292] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.965471] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dde9e57d-f051-4636-9602-1816abd7a20a" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.135163] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1213.135409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.215793] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1214.216274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.216274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.216444] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.216634] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.216755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.216820] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.216974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.217072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.217169] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.455096] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e09d60b0-1676-48ff-9de4-486b63636b40 in Status: SUCCESS [ 1214.455278] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e09d60b0-1676-48ff-9de4-486b63636b40 deletion is rescheduled due to dependency. [ 1214.455408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.719658] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.222556] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.725089] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.725370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.725422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.725755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.725897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.726051] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1215.760745] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.760918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.761046] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.761273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.761430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.771060] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1217.435216] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1217.435509] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1217.783143] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1217.783389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.783568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.783790] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.783986] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.784119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.784184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.784342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.784426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.784510] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.784599] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.286547] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.286750] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.286827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.287150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.287354] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.287470] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.287532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.287693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.287870] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.287870] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.288025] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.288115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.288178] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.288343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.288516] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.288625] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.288671] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.288863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.288919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.289008] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.289103] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.791263] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3608197f-2b1a-43a5-a7dc-0f91c90db3f1: rpc.has_security_group_logging(os_id): False [ 1218.810678] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.810871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.810991] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.811240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.811360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.811587] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.811713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.811790] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.811973] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.812094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.812329] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.812450] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.812524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.812694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.812786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.812996] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.813120] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.813205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.813378] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.813469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.813575] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1218.894940] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.895228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.895228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.895451] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.895603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.909232] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1219.335537] env[70535]: INFO networking_nsxv3.common.synchronization [req-c4165c6c-1d29-43c1-821f-8f93429be08e req-e482872c-8810-4423-9797-90bf0f51fdfe tempest-DeleteServersTestJSON-660883378 tempest-DeleteServersTestJSON-660883378-project-member] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1219.335537] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1219.335537] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.335537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.335537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.335537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.335537] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.335537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.335537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.335537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.335537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.335537] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.839043] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.839043] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.839567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.839567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.839567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.839729] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.839845] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.840160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.840160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.840160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.840300] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1219.873036] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.873250] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.873326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.873630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.873889] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.887683] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1220.925232] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1220.925702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.788792] env[70535]: INFO networking_nsxv3.common.synchronization [req-67c9522f-5d1b-4d0f-b192-df19aec7683d req-8f154c61-d355-4a39-addc-877bcc14e7bb tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_members [ 1221.789441] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGHEST for action security_group_members [ 1221.789819] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f11229e-4f65-4aab-a492-ad9dd37f60f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.789964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.790053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.790266] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.790620] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.790620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.790620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.790774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.793030] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.793030] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.894906] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1221.895151] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f deletion is rescheduled due to dependency. [ 1221.895227] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.227561] env[70535]: INFO networking_nsxv3.common.synchronization [req-ea918433-f381-43e2-8872-cf542dcdfca7 req-c35dd3cd-375c-4607-839b-766affc4a853 tempest-ServerRescueTestJSON-1736721769 tempest-ServerRescueTestJSON-1736721769-project-member] Enqueued Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_members [ 1222.227561] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGHEST for action security_group_members [ 1222.227561] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.227561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.227561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.227561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.227561] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.227561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.227561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.228528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.228730] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.228919] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.295917] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.295917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.295917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.295917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.295917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.295917] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.295917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.295917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.295917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.295917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.295917] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 is going to be updated. [ 1222.328734] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.328884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.328960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.329194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.329404] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.339161] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 in Status: IN_PROGRESS for 2s [ 1222.571047] env[70535]: INFO networking_nsxv3.common.synchronization [req-a649219f-f1d0-4b0b-88ba-7c8e916283d2 req-7ba320f6-7026-41c2-9c81-995dd3e6dc0d tempest-ServersTestJSON-886254797 tempest-ServersTestJSON-886254797-project-member] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1222.571047] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1222.571318] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.571318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.571407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.571613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.571777] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.572128] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.572128] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.574053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.574355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.574500] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.731994] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.732130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.732201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.732473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.732574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.732806] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.733460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.733542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.734617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.734617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.734617] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e is going to be updated. [ 1222.765982] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.766162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.766231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.766434] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.766582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.778436] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e in Status: IN_PROGRESS for 2s [ 1223.077635] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.580287] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.082608] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.082853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.082927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.083171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.083437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.083437] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1224.114777] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.114971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.115047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.115235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.115381] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.126086] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1224.349917] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 in Status: SUCCESS [ 1224.349917] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 deletion is rescheduled due to dependency. [ 1224.349917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.789139] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e in Status: SUCCESS [ 1224.789139] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e deletion is rescheduled due to dependency. [ 1224.789139] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.856831] env[70535]: INFO networking_nsxv3.common.synchronization [req-ecae37f0-2014-4b55-859a-a4a7afbe5289 req-56e95cb2-0f81-4ab9-b2c7-8cc004d5cdb3 tempest-ServerActionsTestOtherB-1362861695 tempest-ServerActionsTestOtherB-1362861695-project-member] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1224.858219] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1224.858332] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.858533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.858639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.858970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.859440] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.859556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.859614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.861035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.861035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.861035] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.363352] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.363600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.363720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.364064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.364406] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.364525] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.364688] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.364793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.365047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.365176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.365319] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be updated. [ 1225.401184] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.401184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.401184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.401184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.401184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.410260] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: IN_PROGRESS for 2s [ 1226.111256] env[70535]: INFO networking_nsxv3.common.synchronization [req-ec1aa5b9-c8a6-45a6-bc48-a614930d3a95 req-39341c43-4596-4823-83a7-ae6304f996d2 tempest-MigrationsAdminTest-1671970304 tempest-MigrationsAdminTest-1671970304-project-member] Enqueued Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_members [ 1226.112102] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_members [ 1226.112447] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.112631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.112740] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.112986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.113211] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.113361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.114283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.114539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.114681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.114825] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.139263] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 4s [ 1226.169157] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.169535] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.169535] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.169814] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.170693] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.172157] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.172325] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.172601] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.172762] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.172995] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.173130] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1226.173259] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1226.173372] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1226.173497] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.173610] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1226.173753] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1226.243369] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1226.243563] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.070 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1226.243685] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1226.243947] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.244323] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.244515] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.244666] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.244980] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.245137] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81b886ef-a6f5-4ba6-bbd4-89628f7701bf',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.616978] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.752034] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.752238] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.752370] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.752666] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.752824] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.752981] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 81b886ef-a6f5-4ba6-bbd4-89628f7701bf not found, creating... [ 1226.753269] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.753444] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.753568] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.753778] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.753920] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.754256] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.754602] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.754602] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.754757] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.754924] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.755200] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 81b886ef-a6f5-4ba6-bbd4-89628f7701bf is going to be created. [ 1226.776409] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.776839] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.776957] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.777379] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.777770] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.778279] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.120696] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.422134] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 1227.422339] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c deletion is rescheduled due to dependency. [ 1227.422461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.501289] env[70535]: INFO networking_nsxv3.common.synchronization [req-ecae37f0-2014-4b55-859a-a4a7afbe5289 req-aaf1a06a-e837-480c-af9a-004a3a1e2acf service nova] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_rules [ 1227.501289] env[70535]: INFO networking_nsxv3.common.synchronization [req-ecae37f0-2014-4b55-859a-a4a7afbe5289 req-aaf1a06a-e837-480c-af9a-004a3a1e2acf service nova] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1227.501289] env[70535]: INFO networking_nsxv3.common.synchronization [req-ecae37f0-2014-4b55-859a-a4a7afbe5289 req-aaf1a06a-e837-480c-af9a-004a3a1e2acf service nova] Enqueued Resource ID: 81b886ef-a6f5-4ba6-bbd4-89628f7701bf with Priority: HIGHEST for action port [ 1227.501289] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_rules [ 1227.501289] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1227.501557] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b886ef-a6f5-4ba6-bbd4-89628f7701bf with Priority: HIGHEST for action port [ 1227.501875] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.501996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.502606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.502814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.502935] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.504411] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.504411] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.504411] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.504714] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.504714] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.504714] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.504836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.504866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.504967] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.505044] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.505770] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.505888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.505961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.506201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.506281] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81b886ef-a6f5-4ba6-bbd4-89628f7701bf',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.627145] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.627145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.627145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.627145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.627145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.627145] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b is going to be updated. [ 1227.656171] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.656360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.656426] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.656646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.657540] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.668661] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b in Status: IN_PROGRESS for 2s [ 1228.009120] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.010760] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.010911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.011059] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81b886ef-a6f5-4ba6-bbd4-89628f7701bf with status ACTIVE [ 1228.011218] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.011323] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.011388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.011756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.011756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.011922] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.011995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.012085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.012198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.012255] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.012434] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.012563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.012633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.012783] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.012857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.012938] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81b886ef-a6f5-4ba6-bbd4-89628f7701bf is going to be updated. [ 1228.039257] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.039474] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.039550] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.039727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.039868] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.040050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.149153] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1228.149478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.511184] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.014072] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.014072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.014072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.014072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.014072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.014321] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be updated. [ 1229.042780] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.042938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.043015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.043236] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.043445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.052594] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: IN_PROGRESS for 2s [ 1229.680923] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b in Status: SUCCESS [ 1229.681935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.062511] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 1231.062921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.062921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.063061] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.063256] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.063375] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.063434] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.063595] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.063676] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.063762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.063855] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.566579] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.806501] env[70535]: INFO networking_nsxv3.common.synchronization [None req-9cf4f79c-2472-47d2-9977-912c2a1cdb03 tempest-AttachInterfacesTestJSON-1348885446 tempest-AttachInterfacesTestJSON-1348885446-project-member] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1231.807615] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGHEST for action security_group_members [ 1231.807615] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.807854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.807854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.807975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.808492] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.808492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.808492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.808776] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.808776] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.808776] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.068868] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f0ce39e-83c0-4345-91bb-9366dd77a60c: rpc.has_security_group_logging(os_id): False [ 1232.089781] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.089781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.089781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.089781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.089781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.089781] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.089781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.089781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.089781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.089781] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.089781] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be updated. [ 1232.153285] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.153432] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.153503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.153725] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.153881] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.173952] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: IN_PROGRESS for 2s [ 1232.311647] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.312008] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.312096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.312348] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.312469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.312775] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.312910] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.312986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.313194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.313281] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.313382] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be updated. [ 1232.345625] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.345871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.345871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.346063] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.346194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.355566] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: IN_PROGRESS for 2s [ 1234.186592] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 1234.186592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.366437] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b in Status: SUCCESS [ 1234.366808] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b deletion is rescheduled due to dependency. [ 1234.366965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.808689] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1236.809063] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1236.867987] env[70535]: INFO networking_nsxv3.common.synchronization [None req-bc789964-c3ab-4307-8580-a6daa77b40ca None None] Enqueued Resource ID: e11c4e85-9cfe-40da-ac7f-4113ea64488b with Priority: HIGHEST for action port [ 1236.868278] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e11c4e85-9cfe-40da-ac7f-4113ea64488b with Priority: HIGHEST for action port [ 1236.868902] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-e11c4e85-9cfe-40da-ac7f-4113ea64488b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.872313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e11c4e85-9cfe-40da-ac7f-4113ea64488b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.872436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e11c4e85-9cfe-40da-ac7f-4113ea64488b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.872751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e11c4e85-9cfe-40da-ac7f-4113ea64488b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.872845] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e11c4e85-9cfe-40da-ac7f-4113ea64488b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.375223] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e11c4e85-9cfe-40da-ac7f-4113ea64488b [ 1237.375701] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.375701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.375701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.375998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.375998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.376145] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e11c4e85-9cfe-40da-ac7f-4113ea64488b already deleted. [ 1237.376145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e11c4e85-9cfe-40da-ac7f-4113ea64488b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.448121] env[70535]: INFO networking_nsxv3.common.synchronization [req-590dafcb-618d-4d77-9b30-680dcbcb9b1a req-00a9c78f-ec2a-4722-b3db-ca4dffb2f9f4 tempest-AttachVolumeShelveTestJSON-2125264447 tempest-AttachVolumeShelveTestJSON-2125264447-project-member] Enqueued Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_members [ 1237.450731] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGHEST for action security_group_members [ 1237.450731] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-76787551-efbb-4eb5-bef3-77685e9cde96 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.450731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.450731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.450731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.450731] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.450731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.450731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.450731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.450731] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.450731] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.953123] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.953697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.953697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.953697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.954719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.954719] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.954719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.954719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.954719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.954719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.954719] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76787551-efbb-4eb5-bef3-77685e9cde96 is going to be updated. [ 1237.993977] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.996212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.996212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.996212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.996212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.005208] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76787551-efbb-4eb5-bef3-77685e9cde96 in Status: IN_PROGRESS for 2s [ 1239.354636] env[70535]: INFO networking_nsxv3.common.synchronization [None req-ba5263d0-3f8f-4899-b9a7-059de8f59c11 None None] Enqueued Resource ID: 96f6a0a4-78a3-4756-8e0d-ad91e85db370 with Priority: HIGHEST for action port [ 1239.355361] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96f6a0a4-78a3-4756-8e0d-ad91e85db370 with Priority: HIGHEST for action port [ 1239.355760] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-96f6a0a4-78a3-4756-8e0d-ad91e85db370 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.355887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96f6a0a4-78a3-4756-8e0d-ad91e85db370" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.355955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96f6a0a4-78a3-4756-8e0d-ad91e85db370" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.356262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96f6a0a4-78a3-4756-8e0d-ad91e85db370" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.356347] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96f6a0a4-78a3-4756-8e0d-ad91e85db370',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.858017] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96f6a0a4-78a3-4756-8e0d-ad91e85db370 [ 1239.858260] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.858397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.858460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.858716] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.858777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.858862] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96f6a0a4-78a3-4756-8e0d-ad91e85db370 already deleted. [ 1239.858941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96f6a0a4-78a3-4756-8e0d-ad91e85db370" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.016025] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76787551-efbb-4eb5-bef3-77685e9cde96 in Status: SUCCESS [ 1240.016256] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76787551-efbb-4eb5-bef3-77685e9cde96 deletion is rescheduled due to dependency. [ 1240.016429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.221728] env[70535]: INFO networking_nsxv3.common.synchronization [req-089137de-7074-4e26-a53f-832ad575b141 req-fed740aa-464c-4434-b4c8-817f4dfab243 tempest-MigrationsAdminTest-1671970304 tempest-MigrationsAdminTest-1671970304-project-member] Enqueued Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_members [ 1240.222789] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGHEST for action security_group_members [ 1240.223182] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.223349] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.223469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.223717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.223910] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.224058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.224153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.224585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.224585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.224585] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.483250] env[70535]: INFO networking_nsxv3.common.synchronization [req-7f6d549e-6b0e-4180-b746-5947fdb53232 req-23503a78-b49a-491d-b8f9-7f4ea5d1ea9d tempest-DeleteServersTestJSON-660883378 tempest-DeleteServersTestJSON-660883378-project-member] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1240.483559] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1240.483759] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.483884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.483955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.484176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.484331] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.484432] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.484496] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.484647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.484737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.484828] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.726316] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.726461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.726534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.726755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.726852] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.727081] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.727172] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.727212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.727354] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.727427] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.727513] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b is going to be updated. [ 1240.774467] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.774678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.774811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.775151] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.775358] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.787156] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b in Status: IN_PROGRESS for 2s [ 1240.843434] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.843642] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.843797] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.844088] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.844355] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.844521] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.844644] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.844871] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.845034] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.845259] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1240.845384] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1240.845501] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1240.845618] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1240.845746] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1240.845843] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1240.845981] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1240.865444] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1240.865621] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1240.865763] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1240.865945] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.866474] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-b94e51b3-6702-4ed0-bbfa-2aa81d255809 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.866667] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-b94e51b3-6702-4ed0-bbfa-2aa81d255809" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.866794] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-b94e51b3-6702-4ed0-bbfa-2aa81d255809" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.867127] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-b94e51b3-6702-4ed0-bbfa-2aa81d255809" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.867268] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b94e51b3-6702-4ed0-bbfa-2aa81d255809',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.989636] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.989636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.989636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.989636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.989636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.989636] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.989636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.989636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.989636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.989636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.989636] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1241.018148] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.018148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.018148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.018148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.018148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.027842] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1241.371410] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.371643] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.371780] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.372103] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.372274] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.372439] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port b94e51b3-6702-4ed0-bbfa-2aa81d255809 not found, creating... [ 1241.372712] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.372874] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.372999] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.373241] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.373387] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.373673] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.373921] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.380277] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.380277] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.380277] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.380277] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: b94e51b3-6702-4ed0-bbfa-2aa81d255809 is going to be created. [ 1241.405393] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.405671] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.405836] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.408835] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.408835] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.408835] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-b94e51b3-6702-4ed0-bbfa-2aa81d255809" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.337986] env[70535]: INFO networking_nsxv3.common.synchronization [req-7f6d549e-6b0e-4180-b746-5947fdb53232 req-c3c0f3ef-be34-4b0e-a5fe-4e494c0739d1 service nova] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_rules [ 1242.337986] env[70535]: INFO networking_nsxv3.common.synchronization [req-7f6d549e-6b0e-4180-b746-5947fdb53232 req-c3c0f3ef-be34-4b0e-a5fe-4e494c0739d1 service nova] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1242.337986] env[70535]: INFO networking_nsxv3.common.synchronization [req-7f6d549e-6b0e-4180-b746-5947fdb53232 req-c3c0f3ef-be34-4b0e-a5fe-4e494c0739d1 service nova] Enqueued Resource ID: b94e51b3-6702-4ed0-bbfa-2aa81d255809 with Priority: HIGHEST for action port [ 1242.337986] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_rules [ 1242.337986] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1242.337986] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b94e51b3-6702-4ed0-bbfa-2aa81d255809 with Priority: HIGHEST for action port [ 1242.338433] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.338499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.338537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.338804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.338804] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.341506] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.341506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.341506] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-b94e51b3-6702-4ed0-bbfa-2aa81d255809 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.341506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b94e51b3-6702-4ed0-bbfa-2aa81d255809" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.341506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b94e51b3-6702-4ed0-bbfa-2aa81d255809" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.341758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b94e51b3-6702-4ed0-bbfa-2aa81d255809" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.341758] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b94e51b3-6702-4ed0-bbfa-2aa81d255809',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.795895] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b in Status: SUCCESS [ 1242.796095] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b deletion is rescheduled due to dependency. [ 1242.796214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.845040] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.845040] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.845040] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b94e51b3-6702-4ed0-bbfa-2aa81d255809 with status ACTIVE [ 1242.845040] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.845040] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.845040] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.845555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.845555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.845555] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.845555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.845716] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.845800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.845954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.846076] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.846171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.846231] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.846396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.846475] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.846563] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b94e51b3-6702-4ed0-bbfa-2aa81d255809 is going to be updated. [ 1242.867897] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.868125] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.868125] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.868429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.868608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.868780] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b94e51b3-6702-4ed0-bbfa-2aa81d255809" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.046847] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1243.047023] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f deletion is rescheduled due to dependency. [ 1243.047113] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.047286] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.047602] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.047778] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.047908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.047984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.048166] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.048247] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.048349] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.551527] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.053698] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.556124] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.556568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.556568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.556568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.556763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.556763] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1244.588734] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.588918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.588974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.589182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.589325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.599306] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1246.614547] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1246.614952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.615214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.615489] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.615737] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.615914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.616060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.616276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.616409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.616555] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.616700] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.119722] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.120033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.120033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.120274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.120469] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.120705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.120705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.120878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.120927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.121055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.121181] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.121274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.121340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.121494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.121655] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.121755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.121824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.122020] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.122122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.122215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.122309] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.338181] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1247.338326] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1247.625528] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9eeea75-d1ec-4e08-9721-eccdc9dae25f: rpc.has_security_group_logging(os_id): False [ 1247.643688] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.643829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.643911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.644145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.644236] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.644433] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.644534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.644606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.644742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.644819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.645019] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.645111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.645169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.645314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.645388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.645578] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.645680] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.645736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.645858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.645932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.646025] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1247.705256] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.705398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.705494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.705700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.705839] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.720926] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1248.003856] env[70535]: INFO networking_nsxv3.common.synchronization [req-af2ad6f2-0f53-4849-9e7c-24c0df0a6e6b req-3570940a-abc9-44f1-8cc6-11314f4e8a86 tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_members [ 1248.004519] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_members [ 1248.004968] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-597eb346-7afe-45b2-a812-9f2a8e62680f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.004968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.006352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.006352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.006352] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.006352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.006352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.006717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.006717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.006717] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.324601] env[70535]: INFO networking_nsxv3.common.synchronization [req-306c1c47-caee-4d54-a24d-68f2e244f288 req-cbe98bc1-b0bd-4f46-9e65-9dedc1fdf82b tempest-ServersTestJSON-886254797 tempest-ServersTestJSON-886254797-project-member] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1248.325244] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1248.325971] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.325971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.325971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.325971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.326226] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.326226] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.326307] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.326412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.326499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.326672] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.513255] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.640692] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.641038] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.641038] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.641363] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.641640] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.641811] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.642855] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.642855] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.642855] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.642855] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1248.643097] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1248.643097] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1248.643164] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1248.643236] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1248.643362] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1248.643534] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1248.664710] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1248.664710] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1248.664710] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1248.664710] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.665087] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-2f4328a8-db5e-4397-b47b-e14a917adf0e taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.665271] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-2f4328a8-db5e-4397-b47b-e14a917adf0e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.665394] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-2f4328a8-db5e-4397-b47b-e14a917adf0e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.665719] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-2f4328a8-db5e-4397-b47b-e14a917adf0e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.665868] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f4328a8-db5e-4397-b47b-e14a917adf0e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.830274] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.015457] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.169605] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.169605] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.169605] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.171223] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.171223] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.171223] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 2f4328a8-db5e-4397-b47b-e14a917adf0e not found, creating... [ 1249.171223] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.171223] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.171223] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.171223] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.171830] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.172396] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.172651] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.172820] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.173092] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.173282] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.173480] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 2f4328a8-db5e-4397-b47b-e14a917adf0e is going to be created. [ 1249.194468] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.194711] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.194843] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.195135] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.195372] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.195657] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-2f4328a8-db5e-4397-b47b-e14a917adf0e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.334129] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.518881] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.519071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.519137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.519336] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.519422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.519527] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 597eb346-7afe-45b2-a812-9f2a8e62680f is going to be updated. [ 1249.549577] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.549819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.549935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.550255] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.550473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.562310] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 597eb346-7afe-45b2-a812-9f2a8e62680f in Status: IN_PROGRESS for 2s [ 1249.737383] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1249.737765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.837554] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.837722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.837794] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.838036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.838131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.838237] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1249.867258] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.867418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.867480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.867732] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.867899] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.877107] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1250.363245] env[70535]: INFO networking_nsxv3.common.synchronization [req-306c1c47-caee-4d54-a24d-68f2e244f288 req-ce5d6a06-bee7-40d2-9f1d-6b74ab7a5d4f service nova] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_rules [ 1250.363245] env[70535]: INFO networking_nsxv3.common.synchronization [req-306c1c47-caee-4d54-a24d-68f2e244f288 req-ce5d6a06-bee7-40d2-9f1d-6b74ab7a5d4f service nova] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1250.363245] env[70535]: INFO networking_nsxv3.common.synchronization [req-306c1c47-caee-4d54-a24d-68f2e244f288 req-ce5d6a06-bee7-40d2-9f1d-6b74ab7a5d4f service nova] Enqueued Resource ID: 2f4328a8-db5e-4397-b47b-e14a917adf0e with Priority: HIGHEST for action port [ 1250.363245] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_rules [ 1250.363507] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1250.363507] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4328a8-db5e-4397-b47b-e14a917adf0e with Priority: HIGHEST for action port [ 1250.363999] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.364232] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.364402] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.364662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.364797] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.365551] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.365736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.365837] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f4328a8-db5e-4397-b47b-e14a917adf0e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.365939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f4328a8-db5e-4397-b47b-e14a917adf0e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.366014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f4328a8-db5e-4397-b47b-e14a917adf0e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.366186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f4328a8-db5e-4397-b47b-e14a917adf0e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.366260] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f4328a8-db5e-4397-b47b-e14a917adf0e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.867739] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.868216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.872367] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f4328a8-db5e-4397-b47b-e14a917adf0e with status ACTIVE [ 1250.872609] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.872768] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.872849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.873089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.873184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.873365] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.873466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.873526] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.873680] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.873758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.873944] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.874088] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.874157] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.874306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.874382] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.874469] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f4328a8-db5e-4397-b47b-e14a917adf0e is going to be updated. [ 1250.901968] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.902225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.902225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.902403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.902542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.902705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f4328a8-db5e-4397-b47b-e14a917adf0e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.572905] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 597eb346-7afe-45b2-a812-9f2a8e62680f in Status: SUCCESS [ 1251.573116] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.887492] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1251.887797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.887937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.888175] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.888366] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.888486] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.888547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.888699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.888782] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.888878] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.185397] env[70535]: INFO networking_nsxv3.common.synchronization [req-8240ec0c-03a5-4084-912c-f554baa4732e req-394c916f-2719-4be0-af09-d8e51f43f1ba tempest-InstanceActionsTestJSON-598935841 tempest-InstanceActionsTestJSON-598935841-project-member] Enqueued Resource ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 with Priority: HIGHEST for action security_group_members [ 1252.189018] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 with Priority: HIGHEST for action security_group_members [ 1252.189018] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc89663-8890-4df0-bfa3-2d910b700bd7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.189018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.189018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.189018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.189018] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.189018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.189018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.189018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.189018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.189018] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc89663-8890-4df0-bfa3-2d910b700bd7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.391124] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.504766] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-984 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.504988] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-984" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.505135] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-984" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.505475] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-984" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.505748] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.505916] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.506368] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.506629] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.506834] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.507194] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1252.507322] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1252.507442] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1252.507556] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1252.507673] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1252.507784] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1252.507969] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1252.525945] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1252.526124] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1252.526268] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1252.526460] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-984" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.527052] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-83e20766-6550-4fd6-8447-13c1a4f3cd13 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.527052] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-83e20766-6550-4fd6-8447-13c1a4f3cd13" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.527330] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-83e20766-6550-4fd6-8447-13c1a4f3cd13" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.527415] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-83e20766-6550-4fd6-8447-13c1a4f3cd13" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.527562] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83e20766-6550-4fd6-8447-13c1a4f3cd13',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.691364] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.691648] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.691648] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.691812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.691908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.692127] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.692227] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.692276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.692431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.692508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.692593] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 already deleted. [ 1252.692674] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.893425] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.030331] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.030565] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.030697] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.031073] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.031245] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.031415] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 83e20766-6550-4fd6-8447-13c1a4f3cd13 not found, creating... [ 1253.031677] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.032263] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.032263] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.032263] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.032421] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.032625] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.032780] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.032903] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.033135] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.033275] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.033418] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 83e20766-6550-4fd6-8447-13c1a4f3cd13 is going to be created. [ 1253.054116] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.054359] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.054492] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.054865] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.055123] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.055363] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-83e20766-6550-4fd6-8447-13c1a4f3cd13" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.396743] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.396899] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.396980] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.397225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.397320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.397425] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1253.429558] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.429994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.429994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.429994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.430238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.439190] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1253.742752] env[70535]: INFO networking_nsxv3.common.synchronization [req-5422f37b-72ab-47cc-97d4-68b17a4fe7c4 req-fe77e994-a881-4e10-8a56-99988469b6f3 tempest-DeleteServersTestJSON-660883378 tempest-DeleteServersTestJSON-660883378-project-member] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1253.743320] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1253.743623] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.743749] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.743818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.747204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.747418] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.747537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.747604] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.747777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.747864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.747956] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.830756] env[70535]: INFO networking_nsxv3.common.synchronization [req-8240ec0c-03a5-4084-912c-f554baa4732e req-7215f5a1-15a8-43b3-846f-ac2e9b41f64a service nova] Enqueued Resource ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 with Priority: HIGHEST for action security_group_rules [ 1253.830946] env[70535]: INFO networking_nsxv3.common.synchronization [req-8240ec0c-03a5-4084-912c-f554baa4732e req-7215f5a1-15a8-43b3-846f-ac2e9b41f64a service nova] Enqueued Resource ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 with Priority: HIGHEST for action security_group_members [ 1253.831141] env[70535]: INFO networking_nsxv3.common.synchronization [req-8240ec0c-03a5-4084-912c-f554baa4732e req-7215f5a1-15a8-43b3-846f-ac2e9b41f64a service nova] Enqueued Resource ID: 83e20766-6550-4fd6-8447-13c1a4f3cd13 with Priority: HIGHEST for action port [ 1253.831653] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 with Priority: HIGHEST for action security_group_rules [ 1253.831736] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 with Priority: HIGHEST for action security_group_members [ 1253.831835] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83e20766-6550-4fd6-8447-13c1a4f3cd13 with Priority: HIGHEST for action port [ 1253.832220] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdc89663-8890-4df0-bfa3-2d910b700bd7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.832349] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.832456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.832740] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.832828] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdc89663-8890-4df0-bfa3-2d910b700bd7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.833904] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc89663-8890-4df0-bfa3-2d910b700bd7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.834028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.834096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.834276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.834428] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.834530] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.834593] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.834767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.834856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.834945] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc89663-8890-4df0-bfa3-2d910b700bd7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.835825] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-83e20766-6550-4fd6-8447-13c1a4f3cd13 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.835996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83e20766-6550-4fd6-8447-13c1a4f3cd13" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.836319] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83e20766-6550-4fd6-8447-13c1a4f3cd13" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.836549] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83e20766-6550-4fd6-8447-13c1a4f3cd13" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.836669] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83e20766-6550-4fd6-8447-13c1a4f3cd13',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.252210] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.252603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.252603] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.252680] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.252807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.252954] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.253156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.253156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.253353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.253353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.253473] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1254.280602] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.280927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.281105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.281221] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.281374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.292324] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1254.339532] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc89663-8890-4df0-bfa3-2d910b700bd7 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.339532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.339532] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdc89663-8890-4df0-bfa3-2d910b700bd7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.340683] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83e20766-6550-4fd6-8447-13c1a4f3cd13 with status ACTIVE [ 1254.340891] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.341024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.341095] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.341454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.341589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.341813] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.341941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.341998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.342275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.342510] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.342590] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.342748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.342748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.342974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.343086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.343233] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83e20766-6550-4fd6-8447-13c1a4f3cd13 is going to be updated. [ 1254.371119] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.371119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.371119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.371119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.371119] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.371412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83e20766-6550-4fd6-8447-13c1a4f3cd13" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.845369] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdc89663-8890-4df0-bfa3-2d910b700bd7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.348467] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.350279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.350279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.350279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.350279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.350279] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 is going to be created. [ 1255.377704] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.377704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.377704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.378011] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.378814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.390989] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 in Status: UNINITIALIZED for 2s [ 1255.458163] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1255.458163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.458163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.458163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.458163] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.458163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.458163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.458503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.458503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.458503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.458594] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.962296] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.962504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.962579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.962859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.963059] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.963138] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.963259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.963375] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.963473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.963575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.963749] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.963836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.963872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.964209] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.964416] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.964541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.964617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.964805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.964893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.964983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.968134] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.308678] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1256.308869] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f deletion is rescheduled due to dependency. [ 1256.308983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.471763] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3608197f-2b1a-43a5-a7dc-0f91c90db3f1: rpc.has_security_group_logging(os_id): False [ 1256.491196] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.491361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.491433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.491659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.491753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.491953] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.492070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.492157] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.492322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.492402] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.492607] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.492701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.492761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.492931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.493751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.494032] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.494201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.494248] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.495152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.495152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.495152] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1256.567209] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.567895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.568086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.568377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.568633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.588399] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1257.406022] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 in Status: SUCCESS [ 1257.406022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.406022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.406022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.406022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.406022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.406022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.406022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.406022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.406022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.406022] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdc89663-8890-4df0-bfa3-2d910b700bd7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.909049] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc89663-8890-4df0-bfa3-2d910b700bd7 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.909408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.909408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.909564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.909709] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.909877] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.909961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.910136] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.910238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.910334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.910488] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc89663-8890-4df0-bfa3-2d910b700bd7 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.910583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.910637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.910844] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.910995] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.911105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.911165] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.911318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.911385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.911467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.911565] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdc89663-8890-4df0-bfa3-2d910b700bd7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.414319] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdc89663-8890-4df0-bfa3-2d910b700bd7: rpc.has_security_group_logging(os_id): False [ 1258.434184] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.434184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.434184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.434184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.434184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.434757] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.434757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.434757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.434757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.434986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.434986] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.435117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.435169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.435295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.435390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.435576] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.435696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.435750] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.435859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.435936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.436029] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 is going to be created. [ 1258.497677] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.497677] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.497988] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.498145] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.498295] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.514819] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 in Status: IN_PROGRESS for 2s [ 1258.604950] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1258.605184] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.832660] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1258.832784] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1260.526791] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 in Status: SUCCESS [ 1260.527089] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.834295] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1263.834803] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1268.608362] env[70535]: INFO networking_nsxv3.common.synchronization [req-430cbc8b-e604-437f-82fe-d43ec8b72dec req-d6cf7235-8680-4656-b0a6-c197aa7efd75 tempest-DeleteServersTestJSON-660883378 tempest-DeleteServersTestJSON-660883378-project-member] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1268.608998] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1268.609486] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.609599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.609673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.609871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.610835] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.610972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.611061] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.611303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.611431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.611554] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.956523] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.956936] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.957229] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.957615] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.958023] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.958367] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.958609] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.958946] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.959300] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.959625] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1268.960073] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1268.960944] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1268.960944] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1268.960944] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1268.960944] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1268.960944] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1268.982733] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1268.983046] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1268.983254] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1268.983441] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-520" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.983886] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-b7b9613e-4dc3-4e34-83a6-79076ee4f10d taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.984288] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-b7b9613e-4dc3-4e34-83a6-79076ee4f10d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.984288] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-b7b9613e-4dc3-4e34-83a6-79076ee4f10d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.984543] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-b7b9613e-4dc3-4e34-83a6-79076ee4f10d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.984689] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7b9613e-4dc3-4e34-83a6-79076ee4f10d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.116960] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.117208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.117208] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.117581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.117581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.117804] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.118073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.118133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.118349] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.118467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.118584] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1269.154611] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.154777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.154846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.155045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.155654] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.164796] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1269.487227] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.487506] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.487606] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.488733] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.488733] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.488733] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port b7b9613e-4dc3-4e34-83a6-79076ee4f10d not found, creating... [ 1269.488929] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.489052] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.489190] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.489445] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.489597] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.490085] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.490274] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.490402] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.490631] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.490773] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.490924] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: b7b9613e-4dc3-4e34-83a6-79076ee4f10d is going to be created. [ 1269.511250] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.511461] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.511582] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.511832] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.512072] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.512300] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-b7b9613e-4dc3-4e34-83a6-79076ee4f10d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.946604] env[70535]: INFO networking_nsxv3.common.synchronization [req-6b77c109-693c-419f-96db-ac5a60364712 req-c0c913fb-6073-4e0e-bccf-986e580b5ba5 tempest-InstanceActionsTestJSON-598935841 tempest-InstanceActionsTestJSON-598935841-project-member] Enqueued Resource ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 with Priority: HIGHEST for action security_group_members [ 1269.947133] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 with Priority: HIGHEST for action security_group_members [ 1269.947429] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc89663-8890-4df0-bfa3-2d910b700bd7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.947552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.947615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.947811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.947965] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.948250] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.948322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.948478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.948566] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.948660] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc89663-8890-4df0-bfa3-2d910b700bd7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.201800] env[70535]: INFO networking_nsxv3.common.synchronization [req-430cbc8b-e604-437f-82fe-d43ec8b72dec req-d0a8d6ad-84c9-4bc9-af06-1866369ef0d4 service nova] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_rules [ 1270.201800] env[70535]: INFO networking_nsxv3.common.synchronization [req-430cbc8b-e604-437f-82fe-d43ec8b72dec req-d0a8d6ad-84c9-4bc9-af06-1866369ef0d4 service nova] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1270.202034] env[70535]: INFO networking_nsxv3.common.synchronization [req-430cbc8b-e604-437f-82fe-d43ec8b72dec req-d0a8d6ad-84c9-4bc9-af06-1866369ef0d4 service nova] Enqueued Resource ID: b7b9613e-4dc3-4e34-83a6-79076ee4f10d with Priority: HIGHEST for action port [ 1270.202682] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_rules [ 1270.202847] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1270.203047] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7b9613e-4dc3-4e34-83a6-79076ee4f10d with Priority: HIGHEST for action port [ 1270.203483] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.204131] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.204257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.204707] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.204849] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.206764] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.206868] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.207212] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7b9613e-4dc3-4e34-83a6-79076ee4f10d taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.207334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7b9613e-4dc3-4e34-83a6-79076ee4f10d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.207415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7b9613e-4dc3-4e34-83a6-79076ee4f10d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.207684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7b9613e-4dc3-4e34-83a6-79076ee4f10d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.207782] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7b9613e-4dc3-4e34-83a6-79076ee4f10d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.454822] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.455033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.455083] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.455277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.455399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.455555] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.455654] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.455717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.455863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.455939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.456036] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 is going to be updated. [ 1270.485641] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.485788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.485953] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.486082] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.486222] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.495244] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 in Status: IN_PROGRESS for 2s [ 1270.707411] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.707543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.709861] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7b9613e-4dc3-4e34-83a6-79076ee4f10d with status ACTIVE [ 1270.710074] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.710203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.710274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.710475] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.710563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.710732] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.710828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.710887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.711112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.711172] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.711334] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.711431] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.711487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.711627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.711702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.711786] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7b9613e-4dc3-4e34-83a6-79076ee4f10d is going to be updated. [ 1270.733040] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.733263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.733263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.733454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.733584] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.733738] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7b9613e-4dc3-4e34-83a6-79076ee4f10d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.941028] env[70535]: INFO networking_nsxv3.common.synchronization [req-1a5e3ca6-9710-4e1e-aadc-b14a33765c56 req-901f692f-02e2-42a5-95ce-628ddff11ba8 tempest-ServersTestJSON-886254797 tempest-ServersTestJSON-886254797-project-member] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1270.941478] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1270.941803] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.941989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.942066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.942264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.942617] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.942617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.942617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.942774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.942887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.942949] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.174235] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1271.174581] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f deletion is rescheduled due to dependency. [ 1271.174581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.174679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.174876] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.175074] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.175198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.175254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.175415] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.175495] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.175590] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.322440] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.322645] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.322753] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.323125] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.323487] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.323758] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.323901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.327327] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.327512] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.327744] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1271.327869] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1271.328019] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1271.328152] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1271.328275] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1271.328389] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1271.328597] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1271.351310] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1271.351310] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1271.351310] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1271.351310] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.351310] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-3283db10-8b80-410d-910e-b509cdc792e1 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.351310] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-3283db10-8b80-410d-910e-b509cdc792e1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.351310] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-3283db10-8b80-410d-910e-b509cdc792e1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.351310] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-3283db10-8b80-410d-910e-b509cdc792e1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.351310] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3283db10-8b80-410d-910e-b509cdc792e1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.447771] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.677570] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.853623] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.853867] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.854024] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.854352] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.854529] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.854777] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 3283db10-8b80-410d-910e-b509cdc792e1 not found, creating... [ 1271.855087] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.855260] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.855384] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.855617] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.855759] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.856051] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.856246] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.856372] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.856586] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.856728] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.856872] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 3283db10-8b80-410d-910e-b509cdc792e1 is going to be created. [ 1271.890533] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.890743] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.890873] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.891276] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.891530] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.891769] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-3283db10-8b80-410d-910e-b509cdc792e1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.951230] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.169824] env[70535]: INFO networking_nsxv3.common.synchronization [req-b1bad088-0b96-41f8-b311-c69be8e6b70c req-22517dbf-1d50-441c-869e-7f1a2ccfbd19 tempest-ServerActionsTestOtherA-1256493987 tempest-ServerActionsTestOtherA-1256493987-project-member] Enqueued Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_members [ 1272.169824] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGHEST for action security_group_members [ 1272.169824] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-597eb346-7afe-45b2-a812-9f2a8e62680f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.169824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.169824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.169824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.169824] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.169824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.169824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.171069] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.171069] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.171069] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.183289] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.457452] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.457452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.457452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.457452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.457452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.457452] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1272.492936] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.492936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.492936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.492936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.492936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.505159] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1272.510564] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 in Status: SUCCESS [ 1272.510739] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 deletion is rescheduled due to dependency. [ 1272.510876] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.567336] env[70535]: INFO networking_nsxv3.common.synchronization [req-1a5e3ca6-9710-4e1e-aadc-b14a33765c56 req-df3dae57-ebf0-4f54-89da-6599e1a8aaf9 service nova] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_rules [ 1272.567534] env[70535]: INFO networking_nsxv3.common.synchronization [req-1a5e3ca6-9710-4e1e-aadc-b14a33765c56 req-df3dae57-ebf0-4f54-89da-6599e1a8aaf9 service nova] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1272.567679] env[70535]: INFO networking_nsxv3.common.synchronization [req-1a5e3ca6-9710-4e1e-aadc-b14a33765c56 req-df3dae57-ebf0-4f54-89da-6599e1a8aaf9 service nova] Enqueued Resource ID: 3283db10-8b80-410d-910e-b509cdc792e1 with Priority: HIGHEST for action port [ 1272.568321] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_rules [ 1272.568616] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1272.568616] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3283db10-8b80-410d-910e-b509cdc792e1 with Priority: HIGHEST for action port [ 1272.568862] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.568963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.569067] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.569391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.569474] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.570461] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.570560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.570761] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-3283db10-8b80-410d-910e-b509cdc792e1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.570871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3283db10-8b80-410d-910e-b509cdc792e1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.570933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3283db10-8b80-410d-910e-b509cdc792e1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.571959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3283db10-8b80-410d-910e-b509cdc792e1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.571959] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3283db10-8b80-410d-910e-b509cdc792e1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.674055] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.674299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.674387] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.674707] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.674847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.675182] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.675315] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.675420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.675661] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.675800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.675905] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 597eb346-7afe-45b2-a812-9f2a8e62680f is going to be updated. [ 1272.686266] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.686457] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.686551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.686778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.686889] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.687013] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1272.725896] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.726063] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.726182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.726435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.726620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.728496] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.728650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.728711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.728856] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.728987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.741196] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1272.741551] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 597eb346-7afe-45b2-a812-9f2a8e62680f in Status: IN_PROGRESS for 2s [ 1273.073308] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.073479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.075793] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3283db10-8b80-410d-910e-b509cdc792e1 with status ACTIVE [ 1273.075970] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.076108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.076174] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.076380] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.076464] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.076638] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.076828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.076958] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.077310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.077449] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.077667] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.077756] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.077825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.078010] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.078143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.078401] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3283db10-8b80-410d-910e-b509cdc792e1 is going to be updated. [ 1273.101288] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.101459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.101522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.101708] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.101847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.102019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3283db10-8b80-410d-910e-b509cdc792e1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.367828] env[70535]: INFO networking_nsxv3.common.synchronization [req-17e3dfd1-9360-43bb-b389-79189fa5e708 req-3e27f0ad-f69a-4e8c-ad52-8626385187c4 tempest-ServerActionsTestJSON-1674828100 tempest-ServerActionsTestJSON-1674828100-project-member] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 1274.367828] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 1274.367828] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.367828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.367828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.367828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.367828] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.367828] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.368637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.368637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.368704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.368815] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.515984] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1274.516955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.517247] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.517527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.517790] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.517944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.518054] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.518266] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.518357] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.518471] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.754021] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1274.754021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.754021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.754021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.754021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.754021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.754021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.754021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.754021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.754021] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.754021] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.756269] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 597eb346-7afe-45b2-a812-9f2a8e62680f in Status: SUCCESS [ 1274.756645] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 597eb346-7afe-45b2-a812-9f2a8e62680f deletion is rescheduled due to dependency. [ 1274.756876] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.871379] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.871583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.871672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.871928] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.872173] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.872417] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.872543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.872607] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.872789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.872895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.873022] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 is going to be updated. [ 1274.904907] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.904907] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.904907] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.905223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.905223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.914750] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: IN_PROGRESS for 2s [ 1275.021478] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.256649] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.256649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.256649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.256649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.256830] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.256830] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.256910] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.257023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.257122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.257234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.257389] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.257485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.257550] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.257681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.257816] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.257904] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.257963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.258153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.258234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.258316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.258406] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.524643] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.760589] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9eeea75-d1ec-4e08-9721-eccdc9dae25f: rpc.has_security_group_logging(os_id): False [ 1275.785517] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.785676] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.785737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.786014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.786072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.786259] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.786360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.786434] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.786585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.786690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.786958] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.787077] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.787142] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.787305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.787392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.787588] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.787696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.787757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.787895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.787969] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.788068] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1275.872195] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.872461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.872522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.872687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.872831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.889014] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1276.032537] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.032801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.032801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.033067] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.033196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.033196] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1276.069163] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.069484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.069484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.069620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.069696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.082345] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1276.924074] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: SUCCESS [ 1276.924399] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 deletion is rescheduled due to dependency. [ 1276.924399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.905709] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1277.905913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.096592] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1278.096900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.097017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.097352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.097439] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.097549] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.097615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.097762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.097843] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.097927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.098032] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.601687] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.601964] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.602107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.602343] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.602521] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.602627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.602693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.602842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.602939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.603048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.603200] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.603298] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.603359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.603503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.603640] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.603733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.603795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.603931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.604014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.604106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.604199] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.109973] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3608197f-2b1a-43a5-a7dc-0f91c90db3f1: rpc.has_security_group_logging(os_id): False [ 1279.131239] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.131404] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.131474] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.131664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.131755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.131940] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.132050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.132111] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.132255] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.132369] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.132709] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.132826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.132826] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.133056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.133705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.133920] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.134041] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.134105] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.134254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.134335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.134456] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1279.205465] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.205765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.205851] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.206093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.206321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.228012] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1279.367936] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1279.368063] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1281.268025] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1281.268025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.559358] env[70535]: INFO networking_nsxv3.common.synchronization [req-249757a9-7d15-4682-a8dc-f464a592f3ff req-04f875da-e253-4197-9b6c-87d7cd70eb11 tempest-ServersTestJSON-886254797 tempest-ServersTestJSON-886254797-project-member] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1281.560296] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1281.560296] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.561025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.561025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.561025] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.561267] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.561267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.561373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.561859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.561859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.561859] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.064796] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.568661] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.070522] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.070522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.070522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.070829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.070865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.070978] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1283.103894] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.104205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.104205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.104478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.104566] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.115606] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1284.388570] env[70535]: INFO networking_nsxv3.common.synchronization [req-2f911d4e-f1ad-4997-9733-d1912aa7996e req-fcda0322-ccbc-47ef-95cb-cf60f02d5064 tempest-ServerRescueNegativeTestJSON-1204437415 tempest-ServerRescueNegativeTestJSON-1204437415-project-member] Enqueued Resource ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 with Priority: HIGHEST for action security_group_members [ 1284.389136] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 with Priority: HIGHEST for action security_group_members [ 1284.389448] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.389578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.389680] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.389923] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.390325] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.390477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.390556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.390753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.390849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.391469] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff34ce6-ae25-41d3-9f90-e1df4be5d574',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.893429] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.893939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.894110] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.894468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.894646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.894967] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.895156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.895267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.895541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.895693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.895875] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 is going to be updated. [ 1284.928372] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.928649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.928649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.928895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.929064] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.939688] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 in Status: IN_PROGRESS for 2s [ 1285.129126] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 4s [ 1286.256501] env[70535]: INFO networking_nsxv3.common.synchronization [req-7a1e4e5b-1c57-4c35-adb0-3217cb07b122 req-4aae441e-37c2-47dc-a009-defd2a35b2f2 tempest-ServerActionsTestJSON-1674828100 tempest-ServerActionsTestJSON-1674828100-project-member] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 1286.257029] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 1286.257346] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.257510] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.257622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.257929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.258124] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.258617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.258710] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.258914] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.259061] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.259178] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.630016] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.630350] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.630558] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.631036] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.631420] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.631703] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.631891] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.632213] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.632431] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.632724] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1286.632884] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1286.633091] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1286.633324] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1286.633516] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1286.633682] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1286.634239] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1286.654725] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1286.654940] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1286.655115] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1286.655355] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-498" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.655710] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-27f80869-ec03-4d94-b970-7c0de0a4215c taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.655972] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-27f80869-ec03-4d94-b970-7c0de0a4215c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.656092] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-27f80869-ec03-4d94-b970-7c0de0a4215c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.656510] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-27f80869-ec03-4d94-b970-7c0de0a4215c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.656674] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27f80869-ec03-4d94-b970-7c0de0a4215c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.761363] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.761572] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.761616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.761831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.761932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.762153] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.762264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.762326] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.762504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.762594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.762631] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 is going to be updated. [ 1286.791056] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.791304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.791304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.791510] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.791650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.802923] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: IN_PROGRESS for 2s [ 1286.950013] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 in Status: SUCCESS [ 1286.950238] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 deletion is rescheduled due to dependency. [ 1286.950385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.140594] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1287.140814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.158870] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.159140] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.159293] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.159648] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.159896] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.159982] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 27f80869-ec03-4d94-b970-7c0de0a4215c not found, creating... [ 1287.160427] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.160625] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.160755] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.160994] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.161162] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.161508] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.161680] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.161928] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.162120] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.162367] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.162572] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 27f80869-ec03-4d94-b970-7c0de0a4215c is going to be created. [ 1287.187128] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.187506] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.187718] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.188208] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.188443] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.188879] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-27f80869-ec03-4d94-b970-7c0de0a4215c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.916030] env[70535]: INFO networking_nsxv3.common.synchronization [req-7a1e4e5b-1c57-4c35-adb0-3217cb07b122 req-0466efd1-a578-47e7-8f29-c11940925fb0 service nova] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_rules [ 1287.916389] env[70535]: INFO networking_nsxv3.common.synchronization [req-7a1e4e5b-1c57-4c35-adb0-3217cb07b122 req-0466efd1-a578-47e7-8f29-c11940925fb0 service nova] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 1287.916389] env[70535]: INFO networking_nsxv3.common.synchronization [req-7a1e4e5b-1c57-4c35-adb0-3217cb07b122 req-0466efd1-a578-47e7-8f29-c11940925fb0 service nova] Enqueued Resource ID: 27f80869-ec03-4d94-b970-7c0de0a4215c with Priority: HIGHEST for action port [ 1287.916933] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_rules [ 1287.917085] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 1287.917211] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27f80869-ec03-4d94-b970-7c0de0a4215c with Priority: HIGHEST for action port [ 1287.917453] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.917577] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.917671] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.917835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.917912] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.919335] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.920692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.920692] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-27f80869-ec03-4d94-b970-7c0de0a4215c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.920692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27f80869-ec03-4d94-b970-7c0de0a4215c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.920692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27f80869-ec03-4d94-b970-7c0de0a4215c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.920692] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27f80869-ec03-4d94-b970-7c0de0a4215c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.920692] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27f80869-ec03-4d94-b970-7c0de0a4215c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.422229] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.422516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.422793] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27f80869-ec03-4d94-b970-7c0de0a4215c with status ACTIVE [ 1288.423081] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.423272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.423388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.423690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.423837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.424139] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.424312] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.424420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.424669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.424816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.425115] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.425277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.425390] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.425628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.425761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.425909] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27f80869-ec03-4d94-b970-7c0de0a4215c is going to be updated. [ 1288.448735] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.449032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.449032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.449220] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.449300] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.449449] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27f80869-ec03-4d94-b970-7c0de0a4215c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.813081] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: SUCCESS [ 1288.813081] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 deletion is rescheduled due to dependency. [ 1288.813372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.813500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.813717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.813903] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.814036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.814103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.814256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.814338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.814431] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.317092] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.819604] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.323218] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.323607] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.323607] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.323607] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.323729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.323784] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 is going to be updated. [ 1290.351820] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.351992] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.351992] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.353028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.353028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.362838] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: IN_PROGRESS for 2s [ 1290.430901] env[70535]: INFO networking_nsxv3.common.synchronization [req-f012784f-57a6-4509-994e-a774eeea0211 req-f3a157f4-b265-4d19-af2f-166d56e6274a tempest-ServersTestJSON-886254797 tempest-ServersTestJSON-886254797-project-member] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1290.430901] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1290.430901] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.431123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.431123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.431228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.431415] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.431520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.431583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.431735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.431827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.431898] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.934460] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.438593] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.941157] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.941391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.941391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.941683] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.941808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.941935] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1291.969749] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.969907] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.969963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.970360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.970585] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.980703] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1292.374563] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: SUCCESS [ 1292.374563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.374853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.375194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.375324] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.375402] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.375402] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.375642] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.375736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.375786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.375851] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.878060] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.380553] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d004720e-0079-4896-920b-7b1e57b6b7b8: rpc.has_security_group_logging(os_id): False [ 1293.399765] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.400027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.400027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.400344] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.400440] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.400637] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.400744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.400810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.400969] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.401082] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.401169] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 is going to be updated. [ 1293.460654] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.460887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.460887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.461083] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.461222] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.474556] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: IN_PROGRESS for 2s [ 1293.990660] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1293.990955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.431223] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.431521] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1295.490073] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: SUCCESS [ 1295.490547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.649336] env[70535]: INFO networking_nsxv3.common.synchronization [req-363883ed-91bb-4196-acf9-d8f3176d7eea req-2021d6c6-a34a-48e7-a306-bfc33eacd640 tempest-ServerRescueNegativeTestJSON-1204437415 tempest-ServerRescueNegativeTestJSON-1204437415-project-member] Enqueued Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_members [ 1295.650687] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_members [ 1295.650687] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.650687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.650687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.650943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.650943] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.651044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.651044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.651383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.651383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.651605] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.153951] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.656770] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.160763] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.160763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.160763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.160763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.160763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.161566] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edae0da3-713a-4ce1-bb9b-f814f5976678 is going to be updated. [ 1297.190055] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.190055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.190055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.190055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.190055] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.199173] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edae0da3-713a-4ce1-bb9b-f814f5976678 in Status: IN_PROGRESS for 2s [ 1299.212500] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edae0da3-713a-4ce1-bb9b-f814f5976678 in Status: SUCCESS [ 1299.213510] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.833322] env[70535]: INFO networking_nsxv3.common.synchronization [req-f68e76ff-50e1-4427-865f-64425befe177 req-bf86a7dc-e041-48db-98cc-4d28d4f5b236 tempest-ServersTestJSON-886254797 tempest-ServersTestJSON-886254797-project-member] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1299.833698] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1299.834013] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.834734] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.834734] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.834734] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.835031] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.835031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.835318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.835318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.835318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.835538] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.079480] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.079480] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.079609] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.079791] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.080067] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.080231] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.080365] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.080797] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.080971] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.081216] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1300.081341] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1300.081508] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1300.081963] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1300.081963] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1300.081963] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1300.082128] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1300.102712] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1300.102957] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1300.103177] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1300.103375] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.103703] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-009d2ff1-ec36-4746-9779-f148f0e24272 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.104211] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-009d2ff1-ec36-4746-9779-f148f0e24272" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.104211] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-009d2ff1-ec36-4746-9779-f148f0e24272" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.104349] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-009d2ff1-ec36-4746-9779-f148f0e24272" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.104497] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('009d2ff1-ec36-4746-9779-f148f0e24272',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.337210] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.607477] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.607739] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.607819] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.608128] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.608287] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.608667] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 009d2ff1-ec36-4746-9779-f148f0e24272 not found, creating... [ 1300.608927] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.609126] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.609255] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.609492] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.609640] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.609964] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.610147] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.610293] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.610564] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.610719] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.610862] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 009d2ff1-ec36-4746-9779-f148f0e24272 is going to be created. [ 1300.634332] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.634567] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.634638] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.634924] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.635176] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.635406] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-009d2ff1-ec36-4746-9779-f148f0e24272" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.839546] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.319827] env[70535]: INFO networking_nsxv3.common.synchronization [req-f68e76ff-50e1-4427-865f-64425befe177 req-d7f9972c-f23a-44b9-911a-e8ecd786a47c service nova] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_rules [ 1301.320083] env[70535]: INFO networking_nsxv3.common.synchronization [req-f68e76ff-50e1-4427-865f-64425befe177 req-d7f9972c-f23a-44b9-911a-e8ecd786a47c service nova] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1301.320268] env[70535]: INFO networking_nsxv3.common.synchronization [req-f68e76ff-50e1-4427-865f-64425befe177 req-d7f9972c-f23a-44b9-911a-e8ecd786a47c service nova] Enqueued Resource ID: 009d2ff1-ec36-4746-9779-f148f0e24272 with Priority: HIGHEST for action port [ 1301.320850] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_rules [ 1301.320994] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1301.321107] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009d2ff1-ec36-4746-9779-f148f0e24272 with Priority: HIGHEST for action port [ 1301.321408] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.321540] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.321600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.321804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.321883] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.322749] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.322862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.323077] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-009d2ff1-ec36-4746-9779-f148f0e24272 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.323182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-009d2ff1-ec36-4746-9779-f148f0e24272" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.323245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-009d2ff1-ec36-4746-9779-f148f0e24272" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.323695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-009d2ff1-ec36-4746-9779-f148f0e24272" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.323784] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('009d2ff1-ec36-4746-9779-f148f0e24272',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.342174] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.342506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.342506] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.342578] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.342698] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.342757] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1301.372098] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.372098] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.372098] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.372098] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.372098] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.381301] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1301.825512] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.825663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.826991] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 009d2ff1-ec36-4746-9779-f148f0e24272 with status ACTIVE [ 1301.827163] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.827279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.827347] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.827715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.827827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.828030] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.828142] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.828209] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.828446] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.828551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.828754] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.828854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.828918] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.829082] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.829160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.829243] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 009d2ff1-ec36-4746-9779-f148f0e24272 is going to be updated. [ 1301.849454] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.849649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.849715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.849963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.850172] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.850422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-009d2ff1-ec36-4746-9779-f148f0e24272" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.393528] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1303.393528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.393983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.393983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.394090] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.394207] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.394286] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.394435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.394520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.394596] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.686217] env[70535]: INFO networking_nsxv3.common.synchronization [req-88530ea0-b603-4ff0-a17d-662441231dc1 req-798dce4f-bc7a-4ce3-b1df-d61189b19393 tempest-ServerRescueNegativeTestJSON-1204437415 tempest-ServerRescueNegativeTestJSON-1204437415-project-member] Enqueued Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_members [ 1303.686803] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGHEST for action security_group_members [ 1303.687138] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.687277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.687423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.687689] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.687874] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.687998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.688181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.688355] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.688462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.688566] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.896870] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.192321] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.192501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.192543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.192757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.213632] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.213919] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.214038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.214109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.214317] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.214394] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.214485] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edae0da3-713a-4ce1-bb9b-f814f5976678 is going to be updated. [ 1304.241237] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.241468] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.241595] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.241885] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.242159] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.242464] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.242464] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.242661] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.242818] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.243034] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1304.243156] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1304.243269] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1304.243380] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1304.243493] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1304.243604] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1304.243737] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1304.245455] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.245569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.245637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.245787] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.245915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.255244] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edae0da3-713a-4ce1-bb9b-f814f5976678 in Status: IN_PROGRESS for 2s [ 1304.264588] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1304.264766] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1304.264911] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1304.265107] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-669" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.265423] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.265604] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.265735] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.266014] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.266169] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81b886ef-a6f5-4ba6-bbd4-89628f7701bf',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.399016] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.768520] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.768760] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.768896] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.769207] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.769365] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.769776] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.770023] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.770167] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.770403] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.770605] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.770928] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.771110] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.771234] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.771450] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.771650] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.771753] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 81b886ef-a6f5-4ba6-bbd4-89628f7701bf is going to be updated. [ 1304.794368] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.794674] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.794807] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.795115] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.795410] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.795709] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.902033] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.902245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.902293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.902482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.902612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.902718] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1304.943150] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.943312] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.943361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.943619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.943710] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.952347] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1305.557835] env[70535]: INFO networking_nsxv3.common.synchronization [req-170b7d75-65f3-4c69-8c8d-0b5d3da5529f req-aca0da17-149f-4375-b6c8-21e31111b4dc service nova] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_rules [ 1305.558144] env[70535]: INFO networking_nsxv3.common.synchronization [req-170b7d75-65f3-4c69-8c8d-0b5d3da5529f req-aca0da17-149f-4375-b6c8-21e31111b4dc service nova] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1305.558144] env[70535]: INFO networking_nsxv3.common.synchronization [req-170b7d75-65f3-4c69-8c8d-0b5d3da5529f req-aca0da17-149f-4375-b6c8-21e31111b4dc service nova] Enqueued Resource ID: 81b886ef-a6f5-4ba6-bbd4-89628f7701bf with Priority: HIGHEST for action port [ 1305.558433] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_rules [ 1305.558570] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1305.558669] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b886ef-a6f5-4ba6-bbd4-89628f7701bf with Priority: HIGHEST for action port [ 1305.559438] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.559581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.559648] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.559864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.559946] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.561268] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.561268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.561268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.561575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.562339] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.562339] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.562453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.562534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.562637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.562762] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.564020] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.565462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.565462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.565462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.565462] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81b886ef-a6f5-4ba6-bbd4-89628f7701bf',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.065029] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.067069] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.067069] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.069842] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81b886ef-a6f5-4ba6-bbd4-89628f7701bf with status ACTIVE [ 1306.069842] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.069842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.069842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.070097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.070097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.070369] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.070558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.070652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.070842] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.070947] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.071179] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.071303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.071387] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.071595] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.071709] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.071821] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81b886ef-a6f5-4ba6-bbd4-89628f7701bf is going to be updated. [ 1306.094296] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.094544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.094544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.094704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.094933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.095125] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81b886ef-a6f5-4ba6-bbd4-89628f7701bf" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.265369] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edae0da3-713a-4ce1-bb9b-f814f5976678 in Status: SUCCESS [ 1306.265573] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edae0da3-713a-4ce1-bb9b-f814f5976678 deletion is rescheduled due to dependency. [ 1306.265698] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.567985] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.962141] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1306.962384] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.962496] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.962737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.963093] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.963234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.963306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.963482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.963588] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.963712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.963813] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.070590] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.070800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.070880] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.071173] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.071282] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.071439] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be updated. [ 1307.103757] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.104010] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.104070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.104321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.104537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.114437] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: IN_PROGRESS for 2s [ 1307.466150] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.466419] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.466522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.466789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.466999] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.467163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.467247] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.467546] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.467546] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.467686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.467802] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.467911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.467911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.468033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.468179] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.468272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.468341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.468492] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.468568] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.468652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.468741] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.971082] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3608197f-2b1a-43a5-a7dc-0f91c90db3f1: rpc.has_security_group_logging(os_id): False [ 1307.989308] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.989729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.989729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.989969] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.990081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.990308] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.990419] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.990569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.990710] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.990791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.991014] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.991115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.991238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.991320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.991417] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.991618] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.991797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.991797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.991920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.991996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.992094] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1308.049372] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.049525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.049617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.049798] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.049944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.064077] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1309.124236] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 1309.124592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.124652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.124835] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.125039] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.125210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.125210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.125416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.125482] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.125538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.125647] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.630075] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.084264] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1310.085130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.134555] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f0ce39e-83c0-4345-91bb-9366dd77a60c: rpc.has_security_group_logging(os_id): False [ 1310.155022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.155022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.155022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.155022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.155022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.155022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.155022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.155022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.155022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.155022] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.155022] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be updated. [ 1310.217953] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.218403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.218483] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.218843] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.219032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.237092] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: IN_PROGRESS for 2s [ 1310.264263] env[70535]: INFO networking_nsxv3.common.synchronization [req-d1b6884a-1fd9-481e-b939-ec2ac16291d8 req-58606e1c-eb63-4fdc-af5e-79a073fe38d3 tempest-DeleteServersTestJSON-660883378 tempest-DeleteServersTestJSON-660883378-project-member] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1310.265931] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGHEST for action security_group_members [ 1310.265931] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.265931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.265931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.265931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.265931] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.265931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.266304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.266304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.266304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.266415] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.773616] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.774070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.774070] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.774268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.774268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.774433] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.774541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.774783] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.774783] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.774894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.774894] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be updated. [ 1310.815907] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.816580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.816580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.816580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.816580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.825541] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: IN_PROGRESS for 2s [ 1311.149442] env[70535]: INFO networking_nsxv3.common.synchronization [req-90b11de9-7b8b-4c7d-947c-c0928d52448a req-62e18531-7ba5-43a1-9a63-297d77415b4e tempest-ServersTestJSON-886254797 tempest-ServersTestJSON-886254797-project-member] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1311.150204] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1311.150568] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.150702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.150807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.150974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.151581] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.151735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.151788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.151979] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.152087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.152184] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.655545] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.158028] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.253209] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 1312.253456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.660509] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.660723] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.660796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.661037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.661147] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.661271] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1312.702159] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.702465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.702465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.702709] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.702897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.715426] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1312.839146] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f in Status: SUCCESS [ 1312.839421] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f deletion is rescheduled due to dependency. [ 1312.839500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.726205] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1314.726527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.151152] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1316.151534] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1317.003649] env[70535]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1317.003810] env[70535]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] NSXv3 Agent Agent loop - iteration:3 started [ 1320.418683] env[70535]: INFO networking_nsxv3.common.synchronization [req-70c2586f-0a2b-485d-adc8-9b09f066eeae req-ca263819-c4eb-44e4-97d1-c677be16f858 tempest-ServersTestJSON-886254797 tempest-ServersTestJSON-886254797-project-member] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1320.419290] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1320.419656] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.419810] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.419889] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.420177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.420365] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.420497] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.420581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.420858] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.420983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.421163] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.668455] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.668721] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.668855] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.669576] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.669576] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.669576] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.669818] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.670130] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.670246] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.670411] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1320.670787] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1320.670787] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1320.670787] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1320.671199] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1320.671199] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1320.671199] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1320.694339] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1320.694619] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1320.694744] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1320.694940] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-119" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.695641] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-0859a023-efb3-4ff6-b379-9e461c1b27f5 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.695641] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-0859a023-efb3-4ff6-b379-9e461c1b27f5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.695885] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-0859a023-efb3-4ff6-b379-9e461c1b27f5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.696189] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-0859a023-efb3-4ff6-b379-9e461c1b27f5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.696293] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0859a023-efb3-4ff6-b379-9e461c1b27f5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.923680] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.198980] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.199206] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.199338] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.199655] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.199790] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.199951] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 0859a023-efb3-4ff6-b379-9e461c1b27f5 not found, creating... [ 1321.200233] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.200395] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.200515] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.200901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.200988] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.201425] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.201612] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.201732] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.201955] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.202112] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.202260] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 0859a023-efb3-4ff6-b379-9e461c1b27f5 is going to be created. [ 1321.224252] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.224473] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.224553] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.224828] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.225082] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.225314] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-0859a023-efb3-4ff6-b379-9e461c1b27f5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.425859] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.901240] env[70535]: INFO networking_nsxv3.common.synchronization [req-70c2586f-0a2b-485d-adc8-9b09f066eeae req-e7b0ce12-4e3d-4a22-92aa-6b4b31db2a8f service nova] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_rules [ 1321.901422] env[70535]: INFO networking_nsxv3.common.synchronization [req-70c2586f-0a2b-485d-adc8-9b09f066eeae req-e7b0ce12-4e3d-4a22-92aa-6b4b31db2a8f service nova] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1321.901580] env[70535]: INFO networking_nsxv3.common.synchronization [req-70c2586f-0a2b-485d-adc8-9b09f066eeae req-e7b0ce12-4e3d-4a22-92aa-6b4b31db2a8f service nova] Enqueued Resource ID: 0859a023-efb3-4ff6-b379-9e461c1b27f5 with Priority: HIGHEST for action port [ 1321.902099] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_rules [ 1321.902247] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1321.904024] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0859a023-efb3-4ff6-b379-9e461c1b27f5 with Priority: HIGHEST for action port [ 1321.904024] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.904024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.904024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.904024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.904024] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.904775] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.904878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.905100] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-0859a023-efb3-4ff6-b379-9e461c1b27f5 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.905204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0859a023-efb3-4ff6-b379-9e461c1b27f5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.905252] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0859a023-efb3-4ff6-b379-9e461c1b27f5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.905432] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0859a023-efb3-4ff6-b379-9e461c1b27f5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.905510] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0859a023-efb3-4ff6-b379-9e461c1b27f5',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.928576] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.928798] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.928885] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.929140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.929238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.929342] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1321.961974] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.962216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.962287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.962473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.962626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.971063] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1322.338982] env[70535]: INFO networking_nsxv3.common.synchronization [req-77f40aa1-812d-4bcf-af71-bb09f414568f req-c0e7b4de-de24-4c96-aa95-14e2c4260315 tempest-ServerActionsTestOtherB-1362861695 tempest-ServerActionsTestOtherB-1362861695-project-member] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1322.339538] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGHEST for action security_group_members [ 1322.339842] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.339968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.340198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.340422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.340587] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.340736] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.340802] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.340959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.341060] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.341152] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.407414] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.407564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.407731] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0859a023-efb3-4ff6-b379-9e461c1b27f5 with status ACTIVE [ 1322.407921] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.408050] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.408123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.408319] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.408407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.408597] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.408718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.408803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.408962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.409068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.409252] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.409347] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.409404] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.409542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.409614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.409697] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0859a023-efb3-4ff6-b379-9e461c1b27f5 is going to be updated. [ 1322.434060] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.434467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.434467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.434601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.434733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.434819] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0859a023-efb3-4ff6-b379-9e461c1b27f5" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.843384] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.843592] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.843639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.843829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.843927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.844139] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.844240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.844302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.844451] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.844528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.844613] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be updated. [ 1322.871290] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.871487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.871487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.871664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.871876] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.880282] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: IN_PROGRESS for 2s [ 1323.982608] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1323.982994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.983162] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.983447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.983680] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.983845] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.983923] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.984110] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.984228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.984333] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.486785] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.891716] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c in Status: SUCCESS [ 1324.891908] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c deletion is rescheduled due to dependency. [ 1324.892024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.989933] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.494406] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.494567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.494639] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.494855] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.494948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.495062] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1325.529653] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.529815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.529884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.530086] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.530236] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.539138] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1327.340568] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.341107] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1327.551292] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1327.551522] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.551691] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.551923] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.552141] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.552299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.552367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.552505] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.552565] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.552679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.552739] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.056067] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.056067] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.056067] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.056410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.056410] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.056529] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.056587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.056767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.056920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.057101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.057331] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.057469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.057539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.057686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.057850] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.057997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.058103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.058305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.058436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.058554] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.058703] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.561126] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3608197f-2b1a-43a5-a7dc-0f91c90db3f1: rpc.has_security_group_logging(os_id): False [ 1328.577648] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.577878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.577878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.578097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.578195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.578392] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.578493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.578557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.578737] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.578825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.579045] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.579147] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.579211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.579354] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.579428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.579609] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.579702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.579763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.579908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.579981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.580077] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1328.639033] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.639249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.639249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.639449] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.639597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.654431] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1330.673671] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1330.674091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.342102] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1332.342360] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1335.005447] env[70535]: INFO networking_nsxv3.common.synchronization [req-fcf55cd5-df4c-42d6-b494-c4ba7ee73567 req-2cdf4ed7-443d-4062-a4dd-50acc5e32a4f tempest-ServersTestJSON-886254797 tempest-ServersTestJSON-886254797-project-member] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1335.006015] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1335.006966] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.006966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.006966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.006966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.006966] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.006966] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.007285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.007285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.007285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.007397] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.513066] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.015652] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.518408] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.518637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.518697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.518958] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.519107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.519107] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1336.550042] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.550042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.550042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.550042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.550042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.558592] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1338.569353] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1338.569758] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.006814] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.006814] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1341.319410] env[70535]: INFO networking_nsxv3.common.synchronization [req-5444a349-76e4-4fec-96fc-8c3e3545eb70 req-1d5b2a75-65ae-40da-bf48-ef4798d76813 tempest-ServersTestJSON-886254797 tempest-ServersTestJSON-886254797-project-member] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1341.319410] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGHEST for action security_group_members [ 1341.319410] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.319410] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.319726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.319761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.319938] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.320091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.320157] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.320303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.320388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.320491] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.824732] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.824732] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.824732] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.824732] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.824732] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.825173] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.825173] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.825173] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.825173] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.825336] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.825336] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be updated. [ 1341.854071] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.854304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.854304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.854474] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.854615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.862734] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: IN_PROGRESS for 2s [ 1343.873680] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 in Status: SUCCESS [ 1343.874071] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 deletion is rescheduled due to dependency. [ 1343.874071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.320203] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1346.320637] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1346.728779] env[70535]: INFO networking_nsxv3.common.synchronization [req-fd1179c8-7bd3-4ab7-98a9-2b9d21c279ff req-0e05724d-1a2f-46bb-a23a-79934113dbd2 tempest-ServerActionsTestJSON-1674828100 tempest-ServerActionsTestJSON-1674828100-project-member] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 1346.729620] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGHEST for action security_group_members [ 1346.729915] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.730318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.730425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.730614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.730773] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.730954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.730954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.731169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.731253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.731352] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.234045] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.234251] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.234251] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.234488] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.234582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.234776] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.234879] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.234941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.235104] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.235182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.235269] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 is going to be updated. [ 1347.262536] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.262760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.262760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.262956] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.263107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.271211] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: IN_PROGRESS for 2s [ 1349.281700] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d004720e-0079-4896-920b-7b1e57b6b7b8 in Status: SUCCESS [ 1349.282205] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 deletion is rescheduled due to dependency. [ 1349.282205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.731426] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1351.731426] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1354.783991] env[70535]: INFO networking_nsxv3.common.synchronization [None req-3fe683b8-fb56-444b-b9c8-727afdd57e20 None None] Enqueued Resource ID: 50ed34e8-6c22-45c0-8085-f9879ca11ffc with Priority: HIGHEST for action port [ 1354.784387] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50ed34e8-6c22-45c0-8085-f9879ca11ffc with Priority: HIGHEST for action port [ 1354.784987] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-50ed34e8-6c22-45c0-8085-f9879ca11ffc taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.785129] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50ed34e8-6c22-45c0-8085-f9879ca11ffc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.785201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50ed34e8-6c22-45c0-8085-f9879ca11ffc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.785552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50ed34e8-6c22-45c0-8085-f9879ca11ffc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.785552] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50ed34e8-6c22-45c0-8085-f9879ca11ffc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.176154] env[70535]: INFO networking_nsxv3.common.synchronization [None req-e8661236-1715-4a62-aa75-ac873edc1397 tempest-AttachVolumeTestJSON-298092302 tempest-AttachVolumeTestJSON-298092302-project-member] Enqueued Resource ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd with Priority: HIGHEST for action security_group_rules [ 1355.176669] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd with Priority: HIGHEST for action security_group_rules [ 1355.177959] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.177959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.177959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.177959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.177959] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6d6cc39-63b8-4783-93c6-b65c1bfaffbd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.249265] env[70535]: INFO networking_nsxv3.common.synchronization [None req-338b9111-5e99-4240-b7d2-21f473d035df tempest-AttachVolumeTestJSON-298092302 tempest-AttachVolumeTestJSON-298092302-project-member] Enqueued Resource ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd with Priority: HIGHEST for action security_group_rules [ 1355.249265] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd with Priority: HIGHEST for action security_group_rules [ 1355.252361] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.252481] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.289808] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50ed34e8-6c22-45c0-8085-f9879ca11ffc [ 1355.290047] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.290180] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.290253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.290465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.290560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.290656] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50ed34e8-6c22-45c0-8085-f9879ca11ffc already deleted. [ 1355.290740] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50ed34e8-6c22-45c0-8085-f9879ca11ffc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.699686] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.699925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.699925] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.700155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.700260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.700388] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd already deleted. [ 1355.700485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.700676] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.701313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.701313] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6d6cc39-63b8-4783-93c6-b65c1bfaffbd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.220051] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.220457] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.220457] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.220534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.220702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.220702] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd already deleted. [ 1356.220778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.549880] env[70535]: INFO networking_nsxv3.common.synchronization [None req-bcaa675d-0713-4bb2-b5a1-4a15e656e4c5 None None] Enqueued Resource ID: 2a0e1852-77a2-406a-90e1-00cb8d671cca with Priority: HIGHEST for action port [ 1356.550437] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a0e1852-77a2-406a-90e1-00cb8d671cca with Priority: HIGHEST for action port [ 1356.551035] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a0e1852-77a2-406a-90e1-00cb8d671cca taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.551289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a0e1852-77a2-406a-90e1-00cb8d671cca" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.551385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a0e1852-77a2-406a-90e1-00cb8d671cca" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.552023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a0e1852-77a2-406a-90e1-00cb8d671cca" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.552023] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a0e1852-77a2-406a-90e1-00cb8d671cca',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.053581] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a0e1852-77a2-406a-90e1-00cb8d671cca [ 1357.053752] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.053897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.053962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.054225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.054320] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.054415] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a0e1852-77a2-406a-90e1-00cb8d671cca already deleted. [ 1357.054516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a0e1852-77a2-406a-90e1-00cb8d671cca" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.944894] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.945385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.945385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.945385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.945514] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.448075] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.950086] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.452851] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1359.453119] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1360.184419] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.184808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.184808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.184808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.197738] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1360.198392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.199091] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1360.236434] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.236640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.236640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.236786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.252172] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.252559] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1360.252662] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1360.252743] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1360.287281] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.287436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.287499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.287701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.289027] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.289027] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1360.363300] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.363620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.363620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.363883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.364207] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.364470] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1360.443052] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.443257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.443257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.443479] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.443773] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.444051] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:40. [ 1360.444151] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'d004720e-0079-4896-920b-7b1e57b6b7b8', '63056e22-45eb-4c1b-b65b-578fb5876c5b', '8f0ce39e-83c0-4345-91bb-9366dd77a60c', 'fdc89663-8890-4df0-bfa3-2d910b700bd7', '9880b7c6-6a3a-464f-abdc-889ae782e20e', 'f1cf765d-0bda-40d5-92f0-076a8eeca55e', 'eda75f17-393d-4d95-8a9b-a7924138f446', '56df97d7-88f0-451d-89de-62650bdc9016', '81327d43-2c13-4e7b-b63b-d04a175b637e', '3608197f-2b1a-43a5-a7dc-0f91c90db3f1', 'edae0da3-713a-4ce1-bb9b-f814f5976678', '07ac4f9b-8f0d-49c2-916e-fc155db340ae', '52023f52-3978-48e2-8510-00221c047d2e', '76787551-efbb-4eb5-bef3-77685e9cde96', '4ff34ce6-ae25-41d3-9f90-e1df4be5d574', '461f32c9-3471-46f7-8f0a-362b6fb196af', '1f11229e-4f65-4aab-a492-ad9dd37f60f1', '7ebf2f9b-61f1-41ce-8d01-84394f8e9115', '1acbf3a7-2fe4-4e7f-abad-c1146da06d6b', 'f932dfa4-49e7-4477-968f-48bf223104fa', '59140a91-434d-4615-899a-f10ff35ce431', 'ec60a8db-faf5-42bd-94a8-662a5418627b', 'efe16881-900e-4f34-a1b9-20cdccf84a3f', 'acf72aac-3e82-4909-b3c4-dccd81be0846', '7b34086e-8eac-4499-9c02-2280b24b0698', 'ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878', '1e51be07-618c-4b2f-9bf9-d52bbd1658e6', 'c9eeea75-d1ec-4e08-9721-eccdc9dae25f', '704d6b72-3e14-4725-96b9-ddcf6d1bb8bc', '137ee755-5484-45a9-a8f1-2a50747a7208', '1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3', '597eb346-7afe-45b2-a812-9f2a8e62680f', 'c8d7fb02-d4e1-40c2-a711-afb7188e3a15', '4671052a-29bf-476d-9785-63d1baee1810', '48008d9c-bbf6-40a2-bb47-24eddd9f74c2', 'e09d60b0-1676-48ff-9de4-486b63636b40', 'ec7c706b-a1b7-4402-b5c2-6e8302636c80', 'bbb53f03-8f48-4baa-b4e6-67243ad60187', 'cf801cfb-8004-42d6-a945-4d3f88953372', 'f32aa9cd-fe8f-4b69-8037-59fa1cf6570c'} {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1360.444254] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1360.464159] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.464367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.464367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.464730] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.464730] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.464896] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1360.464896] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1360.464896] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1360.485643] env[70535]: INFO networking_nsxv3.common.synchronization [req-632a30a4-ad23-4202-97bf-3944a4a1d566 req-fd9d33df-edc4-441a-b8ee-4859b03d42e7 tempest-AttachVolumeTestJSON-298092302 tempest-AttachVolumeTestJSON-298092302-project-member] Enqueued Resource ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd with Priority: HIGHEST for action security_group_members [ 1360.486150] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd with Priority: HIGHEST for action security_group_members [ 1360.486449] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.486569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.486660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.486887] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.487053] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.487148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.487227] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.487347] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.487432] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.487520] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6d6cc39-63b8-4783-93c6-b65c1bfaffbd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.530340] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.530527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.530615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.530767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.531970] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.532175] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1360.532267] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1360.532328] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1360.532389] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1360.532454] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/40 resources of Type:Security Group Rules [ 1360.532524] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGH for action security_group_rules [ 1360.532599] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGH for action security_group_rules [ 1360.532673] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGH for action security_group_rules [ 1360.532725] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 with Priority: HIGH for action security_group_rules [ 1360.532775] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGH for action security_group_rules [ 1360.532828] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGH for action security_group_rules [ 1360.532885] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eda75f17-393d-4d95-8a9b-a7924138f446 with Priority: HIGH for action security_group_rules [ 1360.532944] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 56df97d7-88f0-451d-89de-62650bdc9016 with Priority: HIGH for action security_group_rules [ 1360.533010] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 81327d43-2c13-4e7b-b63b-d04a175b637e with Priority: HIGH for action security_group_rules [ 1360.533078] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGH for action security_group_rules [ 1360.533129] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGH for action security_group_rules [ 1360.533184] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae with Priority: HIGH for action security_group_rules [ 1360.533244] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGH for action security_group_rules [ 1360.533299] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGH for action security_group_rules [ 1360.533374] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 with Priority: HIGH for action security_group_rules [ 1360.533438] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGH for action security_group_rules [ 1360.533488] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGH for action security_group_rules [ 1360.533540] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 with Priority: HIGH for action security_group_rules [ 1360.533675] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGH for action security_group_rules [ 1360.533745] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f932dfa4-49e7-4477-968f-48bf223104fa with Priority: HIGH for action security_group_rules [ 1360.533843] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.730852] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.731145] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-903" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.731346] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-903" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.731813] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-903" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.732741] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.732963] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.733094] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.733335] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.733488] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.733700] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1360.733818] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1360.733925] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1360.734048] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1360.734162] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1360.734282] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1360.734478] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1360.754919] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1360.755171] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1360.755292] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1360.755532] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-903" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.755913] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.756151] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.756291] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.756620] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.756764] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.989123] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.989465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.989465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.989659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.989659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.989837] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.989936] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.989997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.990161] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.990269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.990319] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd already deleted. [ 1360.990403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.259117] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.259488] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.259543] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.259834] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.259991] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.260162] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c not found, creating... [ 1361.260459] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.260675] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.260839] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.261112] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.261326] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.261700] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.261915] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.262063] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.262295] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.262426] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.262571] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c is going to be created. [ 1361.283258] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.283561] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.283648] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.283897] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.284174] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.284408] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.958014] env[70535]: INFO networking_nsxv3.common.synchronization [req-632a30a4-ad23-4202-97bf-3944a4a1d566 req-2606d11d-91e0-4758-9ecd-f9cf04257791 service nova] Enqueued Resource ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd with Priority: HIGHEST for action security_group_rules [ 1361.958135] env[70535]: INFO networking_nsxv3.common.synchronization [req-632a30a4-ad23-4202-97bf-3944a4a1d566 req-2606d11d-91e0-4758-9ecd-f9cf04257791 service nova] Enqueued Resource ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd with Priority: HIGHEST for action security_group_members [ 1361.958282] env[70535]: INFO networking_nsxv3.common.synchronization [req-632a30a4-ad23-4202-97bf-3944a4a1d566 req-2606d11d-91e0-4758-9ecd-f9cf04257791 service nova] Enqueued Resource ID: ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c with Priority: HIGHEST for action port [ 1361.958512] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd with Priority: HIGHEST for action security_group_rules [ 1361.958651] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd with Priority: HIGHEST for action security_group_members [ 1361.958770] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c with Priority: HIGHEST for action port [ 1361.958894] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d004720e-0079-4896-920b-7b1e57b6b7b8 with Priority: HIGH for action security_group_rules [ 1361.958996] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c with Priority: HIGH for action security_group_rules [ 1361.959165] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda75f17-393d-4d95-8a9b-a7924138f446 with Priority: HIGH for action security_group_rules [ 1361.959294] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 with Priority: HIGH for action security_group_rules [ 1361.959369] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f932dfa4-49e7-4477-968f-48bf223104fa with Priority: HIGH for action security_group_rules [ 1361.959430] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b with Priority: HIGH for action security_group_rules [ 1361.959641] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 with Priority: HIGH for action security_group_rules [ 1361.959641] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 with Priority: HIGH for action security_group_rules [ 1361.959773] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76787551-efbb-4eb5-bef3-77685e9cde96 with Priority: HIGH for action security_group_rules [ 1361.959773] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461f32c9-3471-46f7-8f0a-362b6fb196af with Priority: HIGH for action security_group_rules [ 1361.959951] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52023f52-3978-48e2-8510-00221c047d2e with Priority: HIGH for action security_group_rules [ 1361.959951] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae with Priority: HIGH for action security_group_rules [ 1361.960093] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edae0da3-713a-4ce1-bb9b-f814f5976678 with Priority: HIGH for action security_group_rules [ 1361.960161] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 with Priority: HIGH for action security_group_rules [ 1361.960262] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81327d43-2c13-4e7b-b63b-d04a175b637e with Priority: HIGH for action security_group_rules [ 1361.960369] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e with Priority: HIGH for action security_group_rules [ 1361.960454] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56df97d7-88f0-451d-89de-62650bdc9016 with Priority: HIGH for action security_group_rules [ 1361.960546] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e with Priority: HIGH for action security_group_rules [ 1361.960648] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b with Priority: HIGH for action security_group_rules [ 1361.960723] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 with Priority: HIGH for action security_group_rules [ 1361.961315] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.961469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.961531] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.961768] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.961854] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6d6cc39-63b8-4783-93c6-b65c1bfaffbd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.963024] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.963163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.963229] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.963414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.963637] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.963752] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.963816] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.963962] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.964072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.964166] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6d6cc39-63b8-4783-93c6-b65c1bfaffbd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.964909] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.968574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.968574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.968574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.968574] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.968574] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d004720e-0079-4896-920b-7b1e57b6b7b8 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.968574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.968574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.968574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.968574] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d004720e-0079-4896-920b-7b1e57b6b7b8',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.968574] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.968574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.968574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.968574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.968574] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f0ce39e-83c0-4345-91bb-9366dd77a60c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.968574] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eda75f17-393d-4d95-8a9b-a7924138f446 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.968574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.968574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.969346] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.969346] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eda75f17-393d-4d95-8a9b-a7924138f446',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.969907] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.970065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.970133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.970284] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.970359] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ff34ce6-ae25-41d3-9f90-e1df4be5d574',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.970963] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f932dfa4-49e7-4477-968f-48bf223104fa taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.971115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.971187] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.971303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.971373] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f932dfa4-49e7-4477-968f-48bf223104fa',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.972067] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.972220] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.972220] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.972405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.972478] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1acbf3a7-2fe4-4e7f-abad-c1146da06d6b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.973273] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ebf2f9b-61f1-41ce-8d01-84394f8e9115 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.973417] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.973490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.973728] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.973839] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ebf2f9b-61f1-41ce-8d01-84394f8e9115',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.974528] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.974668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.974811] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.974867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.976075] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f11229e-4f65-4aab-a492-ad9dd37f60f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.976075] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76787551-efbb-4eb5-bef3-77685e9cde96 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.976075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.976075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.976075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.976075] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76787551-efbb-4eb5-bef3-77685e9cde96',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.976735] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-461f32c9-3471-46f7-8f0a-362b6fb196af taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.976847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.976908] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.977290] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.977372] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('461f32c9-3471-46f7-8f0a-362b6fb196af',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.978148] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52023f52-3978-48e2-8510-00221c047d2e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.978283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.978449] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.978449] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.978569] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52023f52-3978-48e2-8510-00221c047d2e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.979228] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.979382] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.979486] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.979708] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.979831] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ac4f9b-8f0d-49c2-916e-fc155db340ae',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.982915] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edae0da3-713a-4ce1-bb9b-f814f5976678 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.983112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.983112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.983289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.983419] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edae0da3-713a-4ce1-bb9b-f814f5976678',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.984100] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.984235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.984302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.986028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.986028] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3608197f-2b1a-43a5-a7dc-0f91c90db3f1',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.986028] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81327d43-2c13-4e7b-b63b-d04a175b637e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.986028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.986028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.986028] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.986028] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81327d43-2c13-4e7b-b63b-d04a175b637e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.986425] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.986425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.986425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.986621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.986621] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1cf765d-0bda-40d5-92f0-076a8eeca55e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.987287] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56df97d7-88f0-451d-89de-62650bdc9016 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.987433] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.987517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.987612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.989797] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56df97d7-88f0-451d-89de-62650bdc9016',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.989797] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9880b7c6-6a3a-464f-abdc-889ae782e20e taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.989797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.989797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.989797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.989797] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9880b7c6-6a3a-464f-abdc-889ae782e20e',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.989797] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63056e22-45eb-4c1b-b65b-578fb5876c5b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.989797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.989797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.990202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.990202] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63056e22-45eb-4c1b-b65b-578fb5876c5b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.990772] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdc89663-8890-4df0-bfa3-2d910b700bd7 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.990939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.991121] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.991357] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.991442] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdc89663-8890-4df0-bfa3-2d910b700bd7',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.017348] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.017575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.017575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.017768] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.021942] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.021942] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.038537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.038714] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1acbf3a7-2fe4-4e7f-abad-c1146da06d6b is going to be deleted. [ 1362.039679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.039793] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.060213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.060387] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 461f32c9-3471-46f7-8f0a-362b6fb196af is going to be deleted. [ 1362.091093] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.091379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.091379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.091539] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.091666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.091790] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1acbf3a7-2fe4-4e7f-abad-c1146da06d6b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.108513] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.108719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.108719] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.108916] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.109014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.109141] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-461f32c9-3471-46f7-8f0a-362b6fb196af" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.495042] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.495042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.501090] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6d6cc39-63b8-4783-93c6-b65c1bfaffbd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.502574] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c with status ACTIVE [ 1362.502726] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.502836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.502902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.503117] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.503203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.503373] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.503502] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.503608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.503722] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.503800] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.504026] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.504091] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.504130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.504268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.504342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.504426] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c is going to be updated. [ 1362.547838] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.548148] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.548243] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.548465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.562686] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.562896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.568470] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.568645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.571659] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.571777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.572576] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.572695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.573417] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.573556] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.574287] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.574385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.575076] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.575173] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.575945] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.576059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.576800] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.576898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.577693] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.577796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.579035] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1362.579510] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.579625] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.581741] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1362.582247] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.582358] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.583084] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1362.583492] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.583608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.585172] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1362.585631] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.585739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.587781] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1362.588251] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.588468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.588565] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.588806] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.588950] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.589124] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccfc75a0-9d8a-47c0-82cc-a744d18f3b8c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.592952] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1362.593458] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.593687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.594405] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1362.594884] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.594995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.595745] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1362.596195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.596318] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76787551-efbb-4eb5-bef3-77685e9cde96 is going to be deleted. [ 1362.597828] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.597926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.597995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.598197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.617537] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.617700] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ebf2f9b-61f1-41ce-8d01-84394f8e9115 is going to be deleted. [ 1362.618542] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.618754] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.640640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.640823] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9880b7c6-6a3a-464f-abdc-889ae782e20e is going to be deleted. [ 1362.641733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.641965] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.673021] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.673269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.681599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.681783] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f11229e-4f65-4aab-a492-ad9dd37f60f1 is going to be deleted. [ 1362.682686] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.682894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.684302] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.684421] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.714932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.715139] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81327d43-2c13-4e7b-b63b-d04a175b637e is going to be deleted. [ 1362.715977] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.716202] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.737071] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.737280] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.745352] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.745481] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edae0da3-713a-4ce1-bb9b-f814f5976678 is going to be deleted. [ 1362.746452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.746677] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.749714] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.749832] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.769908] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.770120] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.770798] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.770917] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56df97d7-88f0-451d-89de-62650bdc9016 is going to be deleted. [ 1362.771904] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.772128] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.825950] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.826175] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63056e22-45eb-4c1b-b65b-578fb5876c5b is going to be deleted. [ 1362.827405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.827630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.884478] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.884700] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ff34ce6-ae25-41d3-9f90-e1df4be5d574 is going to be deleted. [ 1362.885533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.885764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.953842] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.954100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.955553] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.955699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.956245] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.956346] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.972023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.972023] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1cf765d-0bda-40d5-92f0-076a8eeca55e is going to be deleted. [ 1362.972678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.972896] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.011140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.011358] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ac4f9b-8f0d-49c2-916e-fc155db340ae is going to be deleted. [ 1363.012339] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6d6cc39-63b8-4783-93c6-b65c1bfaffbd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.013204] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.013425] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.022831] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.022831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.062451] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.062701] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3608197f-2b1a-43a5-a7dc-0f91c90db3f1 is going to be deleted. [ 1363.063588] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.063815] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.090392] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.090652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.108013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.108176] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eda75f17-393d-4d95-8a9b-a7924138f446 is going to be deleted. [ 1363.109213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.109514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.133508] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.133717] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdc89663-8890-4df0-bfa3-2d910b700bd7 is going to be deleted. [ 1363.134623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.134829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.187871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.188082] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52023f52-3978-48e2-8510-00221c047d2e is going to be deleted. [ 1363.188943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.189188] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.205400] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.205616] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.228835] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.229066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.229718] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.229818] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.234299] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.234497] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f932dfa4-49e7-4477-968f-48bf223104fa is going to be deleted. [ 1363.235475] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.235829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.278220] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.278442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.290726] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.290949] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d004720e-0079-4896-920b-7b1e57b6b7b8 is going to be deleted. [ 1363.291838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.292073] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.350460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.350662] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f0ce39e-83c0-4345-91bb-9366dd77a60c is going to be deleted. [ 1363.351581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.351812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.351903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.352044] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76787551-efbb-4eb5-bef3-77685e9cde96" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.352245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.352404] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.352487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.352604] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ebf2f9b-61f1-41ce-8d01-84394f8e9115" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.353163] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.353353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.353501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.353703] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9880b7c6-6a3a-464f-abdc-889ae782e20e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.353849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.354018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.354103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.354223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f11229e-4f65-4aab-a492-ad9dd37f60f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.354351] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.354498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.354584] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.354698] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81327d43-2c13-4e7b-b63b-d04a175b637e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.354825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.354968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.355058] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.355169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56df97d7-88f0-451d-89de-62650bdc9016" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.355294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.355434] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.355509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.355649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63056e22-45eb-4c1b-b65b-578fb5876c5b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.355807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.355961] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.356057] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.356169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edae0da3-713a-4ce1-bb9b-f814f5976678" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.356293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.356435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.356511] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.356622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ff34ce6-ae25-41d3-9f90-e1df4be5d574" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.356746] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.356886] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.356960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.357083] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1cf765d-0bda-40d5-92f0-076a8eeca55e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.357205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.357345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.357423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.357535] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ac4f9b-8f0d-49c2-916e-fc155db340ae" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.357655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.357790] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.357865] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.357974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3608197f-2b1a-43a5-a7dc-0f91c90db3f1" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.358120] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.358253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.358328] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.358438] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdc89663-8890-4df0-bfa3-2d910b700bd7" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.358559] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.358695] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.358770] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.358874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eda75f17-393d-4d95-8a9b-a7924138f446" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.368891] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.369153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.369153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.369397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.369494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.369617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52023f52-3978-48e2-8510-00221c047d2e" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.436022] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.436274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.436274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.436489] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.436583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.436713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f932dfa4-49e7-4477-968f-48bf223104fa" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.438025] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.438168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.438240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.438429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.438516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.438660] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d004720e-0079-4896-920b-7b1e57b6b7b8" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.485035] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1363.485680] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.485829] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.485946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.486171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.486267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.486424] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f0ce39e-83c0-4345-91bb-9366dd77a60c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.515142] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.515547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.515547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.515689] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.515689] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.515758] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd is going to be created. [ 1363.671620] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.671831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.671831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.672062] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.672257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.683536] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd in Status: UNINITIALIZED for 2s [ 1365.694710] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd in Status: SUCCESS [ 1365.694989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.695158] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.695377] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.695570] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.695687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.695751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.695904] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.695986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.696107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.696205] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6d6cc39-63b8-4783-93c6-b65c1bfaffbd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.198361] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6d6cc39-63b8-4783-93c6-b65c1bfaffbd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.700497] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6d6cc39-63b8-4783-93c6-b65c1bfaffbd: rpc.has_security_group_logging(os_id): False [ 1366.719765] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.720019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.720019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.720211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.720329] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.720645] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.720757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.720871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.720976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.721071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.721158] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd is going to be created. [ 1366.787785] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.787952] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.788013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.788222] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.788405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.801925] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd in Status: IN_PROGRESS for 2s [ 1366.961634] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.961837] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1368.816915] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd in Status: SUCCESS [ 1368.817403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.963451] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.963864] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.965303] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1376.965769] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.967029] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.967029] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.968584] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.968584] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1391.969607] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.969607] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1396.970642] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.971101] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1401.972491] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1401.972491] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.973561] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1406.973971] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1411.975073] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.975073] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1416.976510] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.976932] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.977983] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1421.977983] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.978934] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.979293] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.980074] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1431.980074] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.980743] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.981130] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1441.982074] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.982489] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.983435] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.983916] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1451.984224] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.984582] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1456.985480] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.985851] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.986568] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.986911] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.987389] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.987808] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.988601] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.988959] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.989595] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.989953] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.990643] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.991058] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.991499] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.991863] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1492.854438] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1492.854438] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1496.994348] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1496.994727] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1501.031657] env[70535]: INFO networking_nsxv3.common.synchronization [req-cd9cdfb0-8adc-4153-9aab-7c99942fb7c7 req-42c238a6-b910-4713-a084-b8f2f9738fb5 tempest-AttachVolumeTestJSON-298092302 tempest-AttachVolumeTestJSON-298092302-project-member] Enqueued Resource ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd with Priority: HIGHEST for action security_group_members [ 1501.032745] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd with Priority: HIGHEST for action security_group_members [ 1501.032745] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.032745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.032745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.032909] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.033067] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.033587] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.035059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.035268] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.035369] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.035489] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6d6cc39-63b8-4783-93c6-b65c1bfaffbd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.538068] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.538264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.538300] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.538530] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.538630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.538847] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.538940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.539017] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.539167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.539258] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.539382] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd is going to be updated. [ 1501.599073] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.599253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.599287] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.599514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.599661] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.610874] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd in Status: IN_PROGRESS for 2s [ 1503.622062] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd in Status: SUCCESS [ 1503.622457] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd deletion is rescheduled due to dependency. [ 1503.622457] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.669099] env[70535]: INFO networking_nsxv3.common.synchronization [None req-95128353-d6be-4d7c-81c3-55353e3fcfa5 tempest-AttachVolumeTestJSON-298092302 tempest-AttachVolumeTestJSON-298092302-project-member] Enqueued Resource ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef with Priority: HIGHEST for action security_group_rules [ 1505.669626] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef with Priority: HIGHEST for action security_group_rules [ 1505.669932] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.670071] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.670135] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.670408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.670486] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf3924d7-7124-42ac-bed6-6fee8dad31ef',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.738612] env[70535]: INFO networking_nsxv3.common.synchronization [None req-87a6be3b-eeea-4391-89c2-8981d80600ce tempest-AttachVolumeTestJSON-298092302 tempest-AttachVolumeTestJSON-298092302-project-member] Enqueued Resource ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef with Priority: HIGHEST for action security_group_rules [ 1505.739114] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef with Priority: HIGHEST for action security_group_rules [ 1505.739436] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.739557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.192039] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.192235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.192271] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.192481] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.192573] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.192670] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef already deleted. [ 1506.192757] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.192906] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.193092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.193232] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf3924d7-7124-42ac-bed6-6fee8dad31ef',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.713673] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.714068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.714068] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.714183] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.714239] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.714339] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef already deleted. [ 1506.714422] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.740155] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.740472] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1511.368640] env[70535]: INFO networking_nsxv3.common.synchronization [req-3ab155ad-914a-4ad6-8ee6-a4bd73f6de9e req-a75a06da-d2c4-4ce4-9213-6e1ea9b47565 tempest-AttachVolumeTestJSON-298092302 tempest-AttachVolumeTestJSON-298092302-project-member] Enqueued Resource ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef with Priority: HIGHEST for action security_group_members [ 1511.368889] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef with Priority: HIGHEST for action security_group_members [ 1511.369212] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf3924d7-7124-42ac-bed6-6fee8dad31ef taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.369367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.369465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.369658] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.369816] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.370082] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.370151] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.370310] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.370397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.370491] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf3924d7-7124-42ac-bed6-6fee8dad31ef',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.643129] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.643316] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-903" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.643454] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-903" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.643809] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-903" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.644103] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.644287] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.644427] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.644657] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.644808] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.645044] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1511.645171] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1511.645286] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1511.645401] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1511.645517] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1511.645630] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1511.645765] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1511.668577] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1511.668788] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1511.668903] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1511.669152] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-903" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.669422] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-e665b9a5-3f6b-420e-9e1f-8a9dc55b1542 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.669601] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-e665b9a5-3f6b-420e-9e1f-8a9dc55b1542" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.669723] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-e665b9a5-3f6b-420e-9e1f-8a9dc55b1542" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.670079] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-e665b9a5-3f6b-420e-9e1f-8a9dc55b1542" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.670229] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e665b9a5-3f6b-420e-9e1f-8a9dc55b1542',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.872514] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.872869] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.872869] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.872943] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.873053] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.873237] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.873389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.873453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.873612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.873693] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.873778] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef already deleted. [ 1511.873862] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.172978] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.173271] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.173369] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.173671] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.173826] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.173986] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port e665b9a5-3f6b-420e-9e1f-8a9dc55b1542 not found, creating... [ 1512.174276] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.174441] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.174564] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.174793] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.174934] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.175233] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.175393] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.175519] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.175765] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.175911] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.176071] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: e665b9a5-3f6b-420e-9e1f-8a9dc55b1542 is going to be created. [ 1512.200575] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.200789] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.200923] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.201247] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.201523] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.201764] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-e665b9a5-3f6b-420e-9e1f-8a9dc55b1542" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.913032] env[70535]: INFO networking_nsxv3.common.synchronization [req-3ab155ad-914a-4ad6-8ee6-a4bd73f6de9e req-005561fa-31d8-4e52-890e-0cecb280a9e3 service nova] Enqueued Resource ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef with Priority: HIGHEST for action security_group_rules [ 1512.913032] env[70535]: INFO networking_nsxv3.common.synchronization [req-3ab155ad-914a-4ad6-8ee6-a4bd73f6de9e req-005561fa-31d8-4e52-890e-0cecb280a9e3 service nova] Enqueued Resource ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef with Priority: HIGHEST for action security_group_members [ 1512.913032] env[70535]: INFO networking_nsxv3.common.synchronization [req-3ab155ad-914a-4ad6-8ee6-a4bd73f6de9e req-005561fa-31d8-4e52-890e-0cecb280a9e3 service nova] Enqueued Resource ID: e665b9a5-3f6b-420e-9e1f-8a9dc55b1542 with Priority: HIGHEST for action port [ 1512.913032] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef with Priority: HIGHEST for action security_group_rules [ 1512.913032] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef with Priority: HIGHEST for action security_group_members [ 1512.913032] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e665b9a5-3f6b-420e-9e1f-8a9dc55b1542 with Priority: HIGHEST for action port [ 1512.913032] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.913032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.913032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.913032] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.913032] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf3924d7-7124-42ac-bed6-6fee8dad31ef',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.914706] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf3924d7-7124-42ac-bed6-6fee8dad31ef taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.915116] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.915298] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.916484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.916484] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.916484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.916484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.916484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.916484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.916484] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf3924d7-7124-42ac-bed6-6fee8dad31ef',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.917747] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-e665b9a5-3f6b-420e-9e1f-8a9dc55b1542 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.917747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e665b9a5-3f6b-420e-9e1f-8a9dc55b1542" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.917911] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e665b9a5-3f6b-420e-9e1f-8a9dc55b1542" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.918100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e665b9a5-3f6b-420e-9e1f-8a9dc55b1542" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.918348] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e665b9a5-3f6b-420e-9e1f-8a9dc55b1542',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1513.419867] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf3924d7-7124-42ac-bed6-6fee8dad31ef taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.420024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.422971] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e665b9a5-3f6b-420e-9e1f-8a9dc55b1542 with status ACTIVE [ 1513.422971] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.422971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.422971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.422971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.423246] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.423246] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.423402] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.423469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.423632] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.423713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.423890] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.423985] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.424059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.424200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.424284] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.424380] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e665b9a5-3f6b-420e-9e1f-8a9dc55b1542 is going to be updated. [ 1513.425462] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf3924d7-7124-42ac-bed6-6fee8dad31ef',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1513.449897] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.450108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.450108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.450318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.450455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.450615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e665b9a5-3f6b-420e-9e1f-8a9dc55b1542" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.928682] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf3924d7-7124-42ac-bed6-6fee8dad31ef',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1514.431409] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.431648] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.431648] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.431854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.431942] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.432059] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef is going to be created. [ 1514.460435] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.460646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.460646] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.460844] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.460999] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.470125] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef in Status: UNINITIALIZED for 2s [ 1516.480640] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef in Status: SUCCESS [ 1516.481018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.481018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.481260] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.481487] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.481618] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.481685] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.481847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.481932] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.482037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.482129] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf3924d7-7124-42ac-bed6-6fee8dad31ef',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.984587] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf3924d7-7124-42ac-bed6-6fee8dad31ef',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1517.487365] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf3924d7-7124-42ac-bed6-6fee8dad31ef: rpc.has_security_group_logging(os_id): False [ 1517.504855] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.505078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.505078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.505312] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.505437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.505700] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.505813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.505874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.506040] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.506121] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.506208] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef is going to be created. [ 1517.569428] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.569589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.569626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.569839] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.570033] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.580610] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef in Status: IN_PROGRESS for 2s [ 1517.912736] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1517.912952] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1519.594417] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef in Status: SUCCESS [ 1519.594753] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.913768] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1522.914148] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1527.915262] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.915596] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1532.916406] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1532.916846] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1537.917323] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1537.917689] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1542.918188] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1542.918575] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.919951] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1547.919951] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1552.920467] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1552.920891] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1557.004616] env[70535]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1557.004911] env[70535]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] NSXv3 Agent Agent loop - iteration:4 started [ 1557.921323] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1557.921439] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1562.922527] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1562.922984] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1567.923749] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1567.924115] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1572.925169] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1572.925570] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1577.926695] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1577.927142] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1582.927379] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1582.927843] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1587.486781] env[70535]: INFO networking_nsxv3.common.synchronization [req-e0a5fb04-2565-48ff-9361-554588331b47 req-df995b48-13f2-44f3-9b06-c6d876a2ae42 tempest-AttachVolumeTestJSON-298092302 tempest-AttachVolumeTestJSON-298092302-project-member] Enqueued Resource ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef with Priority: HIGHEST for action security_group_members [ 1587.487280] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef with Priority: HIGHEST for action security_group_members [ 1587.487654] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf3924d7-7124-42ac-bed6-6fee8dad31ef taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.487785] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.487845] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.488065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.488231] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.488327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.488394] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.488569] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.488662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.488756] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf3924d7-7124-42ac-bed6-6fee8dad31ef',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1587.991358] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.991575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.991575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.991801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.991895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.992106] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.992210] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.992264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.992419] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.992499] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.992586] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef is going to be updated. [ 1588.028988] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.029199] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.029236] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.029420] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.029562] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.037447] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef in Status: IN_PROGRESS for 2s [ 1590.048372] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef in Status: SUCCESS [ 1590.048798] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef deletion is rescheduled due to dependency. [ 1590.048798] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.488265] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1592.488652] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1597.489694] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1597.490117] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1597.945183] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.945393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.945393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.945627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.945745] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.448295] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.950453] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1599.454309] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1599.454309] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1600.197288] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.197288] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.197584] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.198109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.214576] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1600.215699] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.216436] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1600.257097] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.257367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.257367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.257523] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.273063] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.273912] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1600.273995] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1600.274126] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1600.310234] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.310403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.310447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.310645] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.311242] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.311398] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1600.394212] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.394353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.395504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.395504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.395504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.395504] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1600.467954] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.467954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.467954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.467954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.467954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.467954] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:22. [ 1600.467954] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'bf3924d7-7124-42ac-bed6-6fee8dad31ef', '59140a91-434d-4615-899a-f10ff35ce431', 'ec60a8db-faf5-42bd-94a8-662a5418627b', 'efe16881-900e-4f34-a1b9-20cdccf84a3f', 'acf72aac-3e82-4909-b3c4-dccd81be0846', '7b34086e-8eac-4499-9c02-2280b24b0698', 'ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878', '1e51be07-618c-4b2f-9bf9-d52bbd1658e6', 'c9eeea75-d1ec-4e08-9721-eccdc9dae25f', '704d6b72-3e14-4725-96b9-ddcf6d1bb8bc', '137ee755-5484-45a9-a8f1-2a50747a7208', '1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3', 'f6d6cc39-63b8-4783-93c6-b65c1bfaffbd', '597eb346-7afe-45b2-a812-9f2a8e62680f', 'c8d7fb02-d4e1-40c2-a711-afb7188e3a15', '4671052a-29bf-476d-9785-63d1baee1810', '48008d9c-bbf6-40a2-bb47-24eddd9f74c2', 'e09d60b0-1676-48ff-9de4-486b63636b40', 'ec7c706b-a1b7-4402-b5c2-6e8302636c80', 'bbb53f03-8f48-4baa-b4e6-67243ad60187', 'cf801cfb-8004-42d6-a945-4d3f88953372', 'f32aa9cd-fe8f-4b69-8037-59fa1cf6570c'} {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1600.467954] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1600.487261] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.487423] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.487523] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.487691] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.487777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.487880] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1600.487950] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1600.488034] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1600.554868] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.555047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.555113] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.555303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.556468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.556767] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1600.556873] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1600.556929] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1600.556985] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1600.557096] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/22 resources of Type:Security Group Rules [ 1600.557191] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef with Priority: HIGH for action security_group_rules [ 1600.557272] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGH for action security_group_rules [ 1600.557340] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ec60a8db-faf5-42bd-94a8-662a5418627b with Priority: HIGH for action security_group_rules [ 1600.557405] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGH for action security_group_rules [ 1600.557465] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGH for action security_group_rules [ 1600.557525] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGH for action security_group_rules [ 1600.557581] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGH for action security_group_rules [ 1600.557640] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 with Priority: HIGH for action security_group_rules [ 1600.557698] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGH for action security_group_rules [ 1600.557822] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc with Priority: HIGH for action security_group_rules [ 1600.557822] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 137ee755-5484-45a9-a8f1-2a50747a7208 with Priority: HIGH for action security_group_rules [ 1600.557896] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 with Priority: HIGH for action security_group_rules [ 1600.557920] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd with Priority: HIGH for action security_group_rules [ 1600.557985] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGH for action security_group_rules [ 1600.558057] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGH for action security_group_rules [ 1600.558101] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4671052a-29bf-476d-9785-63d1baee1810 with Priority: HIGH for action security_group_rules [ 1600.558148] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 with Priority: HIGH for action security_group_rules [ 1600.558215] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e09d60b0-1676-48ff-9de4-486b63636b40 with Priority: HIGH for action security_group_rules [ 1600.558274] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGH for action security_group_rules [ 1600.558334] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGH for action security_group_rules [ 1600.558430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.490618] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1602.490890] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1602.491295] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef with Priority: HIGH for action security_group_rules [ 1602.491452] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec60a8db-faf5-42bd-94a8-662a5418627b with Priority: HIGH for action security_group_rules [ 1602.491559] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 with Priority: HIGH for action security_group_rules [ 1602.491663] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 with Priority: HIGH for action security_group_rules [ 1602.491764] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 with Priority: HIGH for action security_group_rules [ 1602.491861] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 with Priority: HIGH for action security_group_rules [ 1602.491953] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09d60b0-1676-48ff-9de4-486b63636b40 with Priority: HIGH for action security_group_rules [ 1602.492059] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 with Priority: HIGH for action security_group_rules [ 1602.492462] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597eb346-7afe-45b2-a812-9f2a8e62680f with Priority: HIGH for action security_group_rules [ 1602.492575] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4671052a-29bf-476d-9785-63d1baee1810 with Priority: HIGH for action security_group_rules [ 1602.492663] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd with Priority: HIGH for action security_group_rules [ 1602.492754] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 with Priority: HIGH for action security_group_rules [ 1602.492844] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137ee755-5484-45a9-a8f1-2a50747a7208 with Priority: HIGH for action security_group_rules [ 1602.492932] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc with Priority: HIGH for action security_group_rules [ 1602.493036] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f with Priority: HIGH for action security_group_rules [ 1602.493151] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b34086e-8eac-4499-9c02-2280b24b0698 with Priority: HIGH for action security_group_rules [ 1602.493262] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 with Priority: HIGH for action security_group_rules [ 1602.493322] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf72aac-3e82-4909-b3c4-dccd81be0846 with Priority: HIGH for action security_group_rules [ 1602.493408] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59140a91-434d-4615-899a-f10ff35ce431 with Priority: HIGH for action security_group_rules [ 1602.493495] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe16881-900e-4f34-a1b9-20cdccf84a3f with Priority: HIGH for action security_group_rules [ 1602.493839] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.493974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.494391] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.494690] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.494795] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf3924d7-7124-42ac-bed6-6fee8dad31ef',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.496463] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec60a8db-faf5-42bd-94a8-662a5418627b taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.496591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.496661] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.496825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.496900] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec60a8db-faf5-42bd-94a8-662a5418627b',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.497640] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.497751] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.498978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.499215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.499297] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.500904] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.501037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.501107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.501261] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.501333] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8d7fb02-d4e1-40c2-a711-afb7188e3a15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.502267] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbb53f03-8f48-4baa-b4e6-67243ad60187 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.502374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.502441] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.502590] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.502662] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbb53f03-8f48-4baa-b4e6-67243ad60187',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.504041] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.504284] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.504389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.504547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.504721] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec7c706b-a1b7-4402-b5c2-6e8302636c80',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.507630] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e09d60b0-1676-48ff-9de4-486b63636b40 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.507735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.507798] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.508015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.508106] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e09d60b0-1676-48ff-9de4-486b63636b40',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.509039] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.509152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.509219] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.509396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.509436] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48008d9c-bbf6-40a2-bb47-24eddd9f74c2',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.510592] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-597eb346-7afe-45b2-a812-9f2a8e62680f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.510789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.510848] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.511106] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.511346] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('597eb346-7afe-45b2-a812-9f2a8e62680f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.512229] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4671052a-29bf-476d-9785-63d1baee1810 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.512346] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.512400] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.512561] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.512637] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4671052a-29bf-476d-9785-63d1baee1810',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.513276] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.513385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.513453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.513601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.513673] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6d6cc39-63b8-4783-93c6-b65c1bfaffbd',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.661398] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.661566] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.661641] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.661843] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.661928] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.662790] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-137ee755-5484-45a9-a8f1-2a50747a7208 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.662884] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.662960] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.663393] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.663393] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('137ee755-5484-45a9-a8f1-2a50747a7208',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.664060] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.664772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.664772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.664772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.664772] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('704d6b72-3e14-4725-96b9-ddcf6d1bb8bc',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.665258] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.665318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.665359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.665524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.665585] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9eeea75-d1ec-4e08-9721-eccdc9dae25f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.666298] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b34086e-8eac-4499-9c02-2280b24b0698 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.666409] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.666504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.666620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.666692] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b34086e-8eac-4499-9c02-2280b24b0698',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.667534] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e51be07-618c-4b2f-9bf9-d52bbd1658e6 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.667534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.667534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.667683] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.667749] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e51be07-618c-4b2f-9bf9-d52bbd1658e6',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.668471] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acf72aac-3e82-4909-b3c4-dccd81be0846 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.668724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.668724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.668853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.668922] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acf72aac-3e82-4909-b3c4-dccd81be0846',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.670195] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59140a91-434d-4615-899a-f10ff35ce431 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.670195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.670195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.670195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.670410] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59140a91-434d-4615-899a-f10ff35ce431',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.671223] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efe16881-900e-4f34-a1b9-20cdccf84a3f taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.671365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.671459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.671617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.671686] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efe16881-900e-4f34-a1b9-20cdccf84a3f',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.698075] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.698075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.698075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.698075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.702631] env[70535]: INFO networking_nsxv3.common.synchronization [None req-72bac1b9-9b53-4f08-95c9-ed268527169f None None] Enqueued Resource ID: 39f42048-9055-43da-a867-8a0e6cbc124c with Priority: HIGHEST for action port [ 1602.702631] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f42048-9055-43da-a867-8a0e6cbc124c with Priority: HIGHEST for action port [ 1602.702631] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-39f42048-9055-43da-a867-8a0e6cbc124c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.702631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39f42048-9055-43da-a867-8a0e6cbc124c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.702631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39f42048-9055-43da-a867-8a0e6cbc124c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.702631] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39f42048-9055-43da-a867-8a0e6cbc124c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.702631] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39f42048-9055-43da-a867-8a0e6cbc124c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.718037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.718037] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48008d9c-bbf6-40a2-bb47-24eddd9f74c2 is going to be deleted. [ 1602.770551] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.770836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.770938] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.771292] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.771392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.771518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48008d9c-bbf6-40a2-bb47-24eddd9f74c2" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.022680] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.022849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.022907] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.023118] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.028972] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.029138] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.034354] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.034500] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.035394] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.035494] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.036212] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.036304] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.037480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.037593] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878 is going to be deleted. [ 1603.038488] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.038694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.057978] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.058145] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbb53f03-8f48-4baa-b4e6-67243ad60187 is going to be deleted. [ 1603.059097] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.059300] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.077286] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.077455] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec7c706b-a1b7-4402-b5c2-6e8302636c80 is going to be deleted. [ 1603.078316] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.078533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.095764] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.095892] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.100872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.101024] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 597eb346-7afe-45b2-a812-9f2a8e62680f is going to be deleted. [ 1603.101941] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.102225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.118431] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.118553] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.121365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.121488] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e09d60b0-1676-48ff-9de4-486b63636b40 is going to be deleted. [ 1603.122501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.123115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.123115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.123115] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca6b82a2-6bd5-4dab-8da1-f4b3c2b49878" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.123225] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.123313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.123389] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.123493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbb53f03-8f48-4baa-b4e6-67243ad60187" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.136485] env[70535]: INFO networking_nsxv3.common.synchronization [None req-ed573184-367b-4169-8322-9bda105cf70b tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 with Priority: HIGHEST for action security_group_rules [ 1603.137147] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 with Priority: HIGHEST for action security_group_rules [ 1603.137468] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a690bc8f-598b-4a61-b995-8ba77d7e9291 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.137595] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.137662] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.137927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.138024] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a690bc8f-598b-4a61-b995-8ba77d7e9291',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1603.196433] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.196591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.196663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.196912] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.197015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.197144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-597eb346-7afe-45b2-a812-9f2a8e62680f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.200327] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.200462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.200534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.200760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.200866] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.200986] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec7c706b-a1b7-4402-b5c2-6e8302636c80" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.208432] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39f42048-9055-43da-a867-8a0e6cbc124c [ 1603.208649] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.208795] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.208863] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.209037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.209141] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.209271] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39f42048-9055-43da-a867-8a0e6cbc124c already deleted. [ 1603.209358] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39f42048-9055-43da-a867-8a0e6cbc124c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.237647] env[70535]: INFO networking_nsxv3.common.synchronization [None req-4e9cba8e-431e-48a5-a99f-70a396235b68 tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 with Priority: HIGHEST for action security_group_rules [ 1603.238785] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.238919] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.238994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.239222] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.242125] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 with Priority: HIGHEST for action security_group_rules [ 1603.242125] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a690bc8f-598b-4a61-b995-8ba77d7e9291 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.242125] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.270233] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.270388] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.279577] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.279702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.280538] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.280630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.281382] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.281504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.282431] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.282519] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.283225] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.283321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.284057] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.284173] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.284851] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.284942] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.285725] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.285812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.286366] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1603.286806] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.286894] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.287508] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1603.288274] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.288274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.289627] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1603.289912] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.290048] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 137ee755-5484-45a9-a8f1-2a50747a7208 is going to be deleted. [ 1603.290922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.291144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.291234] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.291354] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e09d60b0-1676-48ff-9de4-486b63636b40" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.292153] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.292247] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.292315] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.292487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.294239] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.294334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.294949] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1603.295374] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.295468] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.349391] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1603.349994] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.350216] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec60a8db-faf5-42bd-94a8-662a5418627b is going to be deleted. [ 1603.351345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.351576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.397998] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.398176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.427198] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.427337] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efe16881-900e-4f34-a1b9-20cdccf84a3f is going to be deleted. [ 1603.428296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.428519] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.472262] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.472398] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 704d6b72-3e14-4725-96b9-ddcf6d1bb8bc is going to be deleted. [ 1603.473448] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.473668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.504237] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.504682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.519503] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.519635] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59140a91-434d-4615-899a-f10ff35ce431 is going to be deleted. [ 1603.520747] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.520971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.550296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.550458] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e51be07-618c-4b2f-9bf9-d52bbd1658e6 is going to be deleted. [ 1603.551441] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.551669] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.565045] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.565045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.620052] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.620052] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.625064] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.625232] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.635761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.635900] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6d6cc39-63b8-4783-93c6-b65c1bfaffbd is going to be deleted. [ 1603.636895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.637108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.679114] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.679236] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.680076] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.680170] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.686242] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.686385] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acf72aac-3e82-4909-b3c4-dccd81be0846 is going to be deleted. [ 1603.689164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.689412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.737175] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.737406] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf3924d7-7124-42ac-bed6-6fee8dad31ef is going to be deleted. [ 1603.738254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.738484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.785109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.785244] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4671052a-29bf-476d-9785-63d1baee1810 is going to be deleted. [ 1603.786158] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.786379] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.845765] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.845983] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b34086e-8eac-4499-9c02-2280b24b0698 is going to be deleted. [ 1603.846990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.847270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.849759] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.849953] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.863604] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.863890] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.905735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.905735] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8d7fb02-d4e1-40c2-a711-afb7188e3a15 is going to be deleted. [ 1603.905735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.905735] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.938641] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.938641] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.968195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.968195] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3 is going to be deleted. [ 1603.968944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.969196] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.014245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.014391] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9eeea75-d1ec-4e08-9721-eccdc9dae25f is going to be deleted. [ 1604.015418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.015656] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.015745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.015875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-137ee755-5484-45a9-a8f1-2a50747a7208" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.016056] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.016216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.016296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.016437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec60a8db-faf5-42bd-94a8-662a5418627b" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.017018] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.017207] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.017264] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.017367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efe16881-900e-4f34-a1b9-20cdccf84a3f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.017520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.017665] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.017744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.017849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59140a91-434d-4615-899a-f10ff35ce431" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.017971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.018155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.018235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.018345] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-704d6b72-3e14-4725-96b9-ddcf6d1bb8bc" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.018469] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.018621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.018696] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.018804] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e51be07-618c-4b2f-9bf9-d52bbd1658e6" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.018927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.019108] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.019788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.019788] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 already deleted. [ 1604.019788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.019788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.019788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.019788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.020113] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6d6cc39-63b8-4783-93c6-b65c1bfaffbd" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.020113] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.020113] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.020255] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a690bc8f-598b-4a61-b995-8ba77d7e9291',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1604.021709] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.021806] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.021954] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.022039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.022122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.022238] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b34086e-8eac-4499-9c02-2280b24b0698" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.022361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.022535] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.022620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.022728] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acf72aac-3e82-4909-b3c4-dccd81be0846" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.022849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.022993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.023283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.023283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf3924d7-7124-42ac-bed6-6fee8dad31ef" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.026648] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.026770] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.026867] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.027102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.027253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.027440] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4671052a-29bf-476d-9785-63d1baee1810" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.045882] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.045882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.045882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.045882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.045882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.045882] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8d7fb02-d4e1-40c2-a711-afb7188e3a15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.233512] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.233667] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.233740] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.233955] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.234063] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.234179] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cd8c0b9-efc4-4974-9061-fcfd3a17c0a3" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.254639] env[70535]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1604.254938] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.255168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.255273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.255516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.255641] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.256075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9eeea75-d1ec-4e08-9721-eccdc9dae25f" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.540661] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.541039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.541039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.541039] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.541132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.541328] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 already deleted. [ 1604.541395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.906420] env[70535]: INFO networking_nsxv3.common.synchronization [None req-3f91e0f3-40a2-440b-a443-94a3615be564 None None] Enqueued Resource ID: 62b8f840-7d11-4a25-812e-9a71077209ca with Priority: HIGHEST for action port [ 1604.906912] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b8f840-7d11-4a25-812e-9a71077209ca with Priority: HIGHEST for action port [ 1604.907229] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-62b8f840-7d11-4a25-812e-9a71077209ca taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.907347] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62b8f840-7d11-4a25-812e-9a71077209ca" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.907403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62b8f840-7d11-4a25-812e-9a71077209ca" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.907671] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62b8f840-7d11-4a25-812e-9a71077209ca" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.907749] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62b8f840-7d11-4a25-812e-9a71077209ca',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1605.410850] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62b8f840-7d11-4a25-812e-9a71077209ca [ 1605.411232] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1605.411232] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1605.411341] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1605.411496] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1605.411583] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1605.411682] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62b8f840-7d11-4a25-812e-9a71077209ca already deleted. [ 1605.411801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62b8f840-7d11-4a25-812e-9a71077209ca" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.790112] env[70535]: INFO networking_nsxv3.common.synchronization [req-df6bd766-d8b5-4808-929a-9c59e44dded3 req-9a3fd923-8807-404c-9dce-f1d9665406ed tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 with Priority: HIGHEST for action security_group_members [ 1608.790417] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 with Priority: HIGHEST for action security_group_members [ 1608.790730] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-a690bc8f-598b-4a61-b995-8ba77d7e9291 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.790854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.790913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.791216] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.791370] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.791473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.791536] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.791715] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.791827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.791923] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a690bc8f-598b-4a61-b995-8ba77d7e9291',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.050260] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.050467] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.050596] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.050952] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.051246] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.051414] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.051536] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.051759] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.051915] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.052144] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1609.052265] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1609.052375] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1609.052484] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1609.052594] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1609.052703] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1609.052837] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1609.073503] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1609.073733] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1609.073828] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1609.074048] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.074379] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-3de4a2d8-553b-47d8-aaaf-52fa372eaf79 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.074557] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-3de4a2d8-553b-47d8-aaaf-52fa372eaf79" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.074754] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-3de4a2d8-553b-47d8-aaaf-52fa372eaf79" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.075106] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-3de4a2d8-553b-47d8-aaaf-52fa372eaf79" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.075268] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3de4a2d8-553b-47d8-aaaf-52fa372eaf79',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.294481] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.294718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.294718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.294900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.294989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.295215] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.295313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.295375] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.295518] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.295594] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.295694] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 already deleted. [ 1609.295777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.578223] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.578466] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.578600] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.578903] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.579079] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.579243] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 3de4a2d8-553b-47d8-aaaf-52fa372eaf79 not found, creating... [ 1609.579508] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.579677] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.579787] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.580028] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.580167] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.580458] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.580616] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.580736] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.580947] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.581102] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.581249] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 3de4a2d8-553b-47d8-aaaf-52fa372eaf79 is going to be created. [ 1609.603787] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.604047] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.604182] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.604457] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.604718] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.604964] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-3de4a2d8-553b-47d8-aaaf-52fa372eaf79" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.270738] env[70535]: INFO networking_nsxv3.common.synchronization [req-df6bd766-d8b5-4808-929a-9c59e44dded3 req-ec340bce-6a85-495f-a813-d503f4139e97 service nova] Enqueued Resource ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 with Priority: HIGHEST for action security_group_rules [ 1610.270986] env[70535]: INFO networking_nsxv3.common.synchronization [req-df6bd766-d8b5-4808-929a-9c59e44dded3 req-ec340bce-6a85-495f-a813-d503f4139e97 service nova] Enqueued Resource ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 with Priority: HIGHEST for action security_group_members [ 1610.271086] env[70535]: INFO networking_nsxv3.common.synchronization [req-df6bd766-d8b5-4808-929a-9c59e44dded3 req-ec340bce-6a85-495f-a813-d503f4139e97 service nova] Enqueued Resource ID: 3de4a2d8-553b-47d8-aaaf-52fa372eaf79 with Priority: HIGHEST for action port [ 1610.271315] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 with Priority: HIGHEST for action security_group_rules [ 1610.271447] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 with Priority: HIGHEST for action security_group_members [ 1610.271543] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3de4a2d8-553b-47d8-aaaf-52fa372eaf79 with Priority: HIGHEST for action port [ 1610.272181] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a690bc8f-598b-4a61-b995-8ba77d7e9291 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.272327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.272397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.272629] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.272714] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a690bc8f-598b-4a61-b995-8ba77d7e9291',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1610.273903] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-a690bc8f-598b-4a61-b995-8ba77d7e9291 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.274110] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.274193] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.274367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.274516] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.274612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.274703] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.274853] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.274940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.275037] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a690bc8f-598b-4a61-b995-8ba77d7e9291',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1610.276118] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-3de4a2d8-553b-47d8-aaaf-52fa372eaf79 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.276224] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3de4a2d8-553b-47d8-aaaf-52fa372eaf79" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.277019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3de4a2d8-553b-47d8-aaaf-52fa372eaf79" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.277019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3de4a2d8-553b-47d8-aaaf-52fa372eaf79" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.277019] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3de4a2d8-553b-47d8-aaaf-52fa372eaf79',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1610.774828] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-a690bc8f-598b-4a61-b995-8ba77d7e9291 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.774963] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.776294] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a690bc8f-598b-4a61-b995-8ba77d7e9291',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1610.779082] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3de4a2d8-553b-47d8-aaaf-52fa372eaf79 with status ACTIVE [ 1610.779254] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.779374] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.779437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.779637] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.779724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.779912] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.780024] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.780074] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.780217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.780291] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.780471] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.780564] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.780624] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.780761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.781100] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.781100] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3de4a2d8-553b-47d8-aaaf-52fa372eaf79 is going to be updated. [ 1610.801353] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.801533] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.801576] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.801738] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.801880] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.802059] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3de4a2d8-553b-47d8-aaaf-52fa372eaf79" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1611.278681] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a690bc8f-598b-4a61-b995-8ba77d7e9291',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1611.781057] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1611.781226] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1611.781297] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1611.781524] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1611.781617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1611.781719] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 is going to be created. [ 1611.805823] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1611.806035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1611.806181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1611.806325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1611.806484] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1611.816576] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 in Status: UNINITIALIZED for 2s [ 1613.827819] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 in Status: SUCCESS [ 1613.828182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.828215] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.828430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.828622] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.828807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.828807] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.828959] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.829061] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.829150] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.829256] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a690bc8f-598b-4a61-b995-8ba77d7e9291',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1614.331256] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a690bc8f-598b-4a61-b995-8ba77d7e9291',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1614.833629] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a690bc8f-598b-4a61-b995-8ba77d7e9291: rpc.has_security_group_logging(os_id): False [ 1614.851593] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.851817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.851903] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.852167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.852298] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.852549] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.852664] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.852723] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.852933] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.852974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.853040] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 is going to be created. [ 1614.912055] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.912235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.912272] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.912490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.912705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.926871] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 in Status: IN_PROGRESS for 2s [ 1615.273017] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1615.273264] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1616.941142] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 in Status: SUCCESS [ 1616.941513] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1620.274412] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1620.274707] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1625.275351] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1625.275760] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1630.276479] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1630.276776] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1635.277985] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1635.278381] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1640.279404] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1640.279805] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1645.280267] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1645.280728] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1650.281050] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1650.281400] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1655.282410] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1655.282811] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1660.283288] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1660.283614] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1665.284462] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1665.284922] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1666.980195] env[70535]: INFO networking_nsxv3.common.synchronization [None req-563ca6bb-a518-43d6-bbc0-7a4e8ed91f0f tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 with Priority: HIGHEST for action security_group_rules [ 1666.980682] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 with Priority: HIGHEST for action security_group_rules [ 1666.981012] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1666.981158] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1666.981250] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1666.981466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1666.981551] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea6f373-312d-4294-911b-5e12a2fbc3f4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1667.044299] env[70535]: INFO networking_nsxv3.common.synchronization [None req-72e21373-bca6-4ee9-99e2-f4a00a997883 tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 with Priority: HIGHEST for action security_group_rules [ 1667.044809] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 with Priority: HIGHEST for action security_group_rules [ 1667.045187] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1667.045294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1667.942907] env[70535]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function GET Argumetns {'path': '/policy/api/v1/infra/domains/default/security-policies/default-layer3-logged-drop-section/rules', 'params': {'page_size': 200, 'cursor': ''}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 1667.943142] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=70535) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:122}} [ 1669.969130] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1669.969541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1669.969541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1669.969613] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1669.969643] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1669.969784] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 already deleted. [ 1669.969843] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1669.969950] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1669.970124] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1669.970206] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea6f373-312d-4294-911b-5e12a2fbc3f4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1670.490756] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1670.490900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1670.490993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1670.491211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1670.491301] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1670.491395] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 already deleted. [ 1670.491493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.046399] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1672.046399] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1672.289538] env[70535]: INFO networking_nsxv3.common.synchronization [req-1ffb6c3c-a275-496f-bed5-6a97e9ef50e3 req-4b50f84b-6ba5-46ed-92e7-4010fe621832 tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 with Priority: HIGHEST for action security_group_members [ 1672.290102] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 with Priority: HIGHEST for action security_group_members [ 1672.290416] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea6f373-312d-4294-911b-5e12a2fbc3f4 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.290541] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.290611] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.290857] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.291024] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.291223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.291285] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.291447] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.291531] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.291626] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea6f373-312d-4294-911b-5e12a2fbc3f4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1672.533263] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.533497] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.533644] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.533943] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.534292] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.534524] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.534696] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.534931] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.535102] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.535347] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1672.535477] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1672.535650] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1672.535824] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1672.535926] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1672.536053] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1672.536195] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1672.557499] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1672.557634] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1672.557748] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1672.557960] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.558346] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-56515e8d-147c-42c9-9b56-1e8ed5a6c7ff taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.558548] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-56515e8d-147c-42c9-9b56-1e8ed5a6c7ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.558679] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-56515e8d-147c-42c9-9b56-1e8ed5a6c7ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.559009] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-56515e8d-147c-42c9-9b56-1e8ed5a6c7ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.559170] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56515e8d-147c-42c9-9b56-1e8ed5a6c7ff',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1672.794955] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.795229] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.795229] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.795365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.795456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.795688] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1672.795779] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1672.795844] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1672.795993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1672.796082] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1672.796165] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 already deleted. [ 1672.796244] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.061098] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.061497] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.061497] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.061716] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.061879] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.062052] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 56515e8d-147c-42c9-9b56-1e8ed5a6c7ff not found, creating... [ 1673.062317] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.062554] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.062629] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.062815] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.062959] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.063258] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.063480] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.063593] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.063747] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.063887] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.064043] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 56515e8d-147c-42c9-9b56-1e8ed5a6c7ff is going to be created. [ 1673.090202] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.090399] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.090499] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.090780] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.091027] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.091257] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-56515e8d-147c-42c9-9b56-1e8ed5a6c7ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.747985] env[70535]: INFO networking_nsxv3.common.synchronization [req-1ffb6c3c-a275-496f-bed5-6a97e9ef50e3 req-f060f97d-0afe-4fd9-9ee7-825c09a7f73f service nova] Enqueued Resource ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 with Priority: HIGHEST for action security_group_rules [ 1673.748248] env[70535]: INFO networking_nsxv3.common.synchronization [req-1ffb6c3c-a275-496f-bed5-6a97e9ef50e3 req-f060f97d-0afe-4fd9-9ee7-825c09a7f73f service nova] Enqueued Resource ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 with Priority: HIGHEST for action security_group_members [ 1673.748405] env[70535]: INFO networking_nsxv3.common.synchronization [req-1ffb6c3c-a275-496f-bed5-6a97e9ef50e3 req-f060f97d-0afe-4fd9-9ee7-825c09a7f73f service nova] Enqueued Resource ID: 56515e8d-147c-42c9-9b56-1e8ed5a6c7ff with Priority: HIGHEST for action port [ 1673.748595] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 with Priority: HIGHEST for action security_group_rules [ 1673.748730] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 with Priority: HIGHEST for action security_group_members [ 1673.748824] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56515e8d-147c-42c9-9b56-1e8ed5a6c7ff with Priority: HIGHEST for action port [ 1673.749359] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.749485] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.749560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.749755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.749838] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea6f373-312d-4294-911b-5e12a2fbc3f4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1673.752479] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea6f373-312d-4294-911b-5e12a2fbc3f4 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.752600] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.752666] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.752837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.752981] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.753085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.753146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.753283] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.753365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1673.753452] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea6f373-312d-4294-911b-5e12a2fbc3f4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1673.754147] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-56515e8d-147c-42c9-9b56-1e8ed5a6c7ff taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1673.754253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56515e8d-147c-42c9-9b56-1e8ed5a6c7ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1673.754313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56515e8d-147c-42c9-9b56-1e8ed5a6c7ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1673.755031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56515e8d-147c-42c9-9b56-1e8ed5a6c7ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1673.755031] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56515e8d-147c-42c9-9b56-1e8ed5a6c7ff',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1674.256580] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea6f373-312d-4294-911b-5e12a2fbc3f4 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.256915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.256915] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ea6f373-312d-4294-911b-5e12a2fbc3f4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1674.257807] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56515e8d-147c-42c9-9b56-1e8ed5a6c7ff with status ACTIVE [ 1674.258027] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.258169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.258240] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1674.258461] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1674.258552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1674.258732] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.258836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.258905] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1674.259081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1674.259177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1674.259362] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.259456] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.259517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1674.259748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1674.259748] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1674.259839] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56515e8d-147c-42c9-9b56-1e8ed5a6c7ff is going to be updated. [ 1674.284112] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.284303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.284303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1674.284480] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1674.284614] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1674.284775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56515e8d-147c-42c9-9b56-1e8ed5a6c7ff" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1674.762954] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ea6f373-312d-4294-911b-5e12a2fbc3f4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1675.266085] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.266085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.266085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.266085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.266085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.266085] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 is going to be created. [ 1675.291113] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.291366] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.291366] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.291681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.291681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.301066] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 in Status: UNINITIALIZED for 2s [ 1677.312070] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 in Status: SUCCESS [ 1677.312414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.312414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.312672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.312959] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1677.313146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1677.313249] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.313421] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.313516] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.313626] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.313721] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea6f373-312d-4294-911b-5e12a2fbc3f4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1677.815881] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea6f373-312d-4294-911b-5e12a2fbc3f4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1678.318871] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea6f373-312d-4294-911b-5e12a2fbc3f4: rpc.has_security_group_logging(os_id): False [ 1678.336659] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.336790] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1678.336859] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1678.337045] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1678.337181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1678.337392] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.337498] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1678.337546] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1678.337697] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1678.337772] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1678.337858] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 is going to be created. [ 1678.398128] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.398356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1678.398356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1678.398550] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1678.398733] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1678.408752] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 in Status: IN_PROGRESS for 2s [ 1678.749727] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1678.750050] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1680.422347] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 in Status: SUCCESS [ 1680.422598] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1683.750698] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1683.750698] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1688.751774] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1688.752234] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1693.752861] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1693.753243] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1698.753796] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1698.754264] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1703.755225] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1703.755589] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1708.756469] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1708.756824] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1713.758084] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1713.758526] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1718.759479] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1718.759899] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1720.581392] env[70535]: INFO networking_nsxv3.common.synchronization [req-950668ea-8f0e-4d2d-a735-f258a7282694 req-5f1979e0-3a74-4b0b-9cc8-f0f510f39035 tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 with Priority: HIGHEST for action security_group_members [ 1720.581392] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 with Priority: HIGHEST for action security_group_members [ 1720.581392] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea6f373-312d-4294-911b-5e12a2fbc3f4 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.581392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.581392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.581724] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.581754] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1720.581833] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1720.581893] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1720.582099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1720.582378] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1720.582378] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea6f373-312d-4294-911b-5e12a2fbc3f4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1721.085132] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.085132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1721.085132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1721.085132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1721.085132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1721.085445] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.085445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1721.085445] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1721.085550] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1721.085550] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1721.085684] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 is going to be updated. [ 1721.113773] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.114015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1721.114015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1721.114254] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1721.114419] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1721.122429] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 in Status: IN_PROGRESS for 2s [ 1723.132678] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 in Status: SUCCESS [ 1723.133109] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 deletion is rescheduled due to dependency. [ 1723.133109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1725.582465] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1725.582465] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1730.583439] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1730.583763] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1731.843572] env[70535]: INFO networking_nsxv3.common.synchronization [req-7b3e723e-52ee-4db6-a559-9011bfdc4c5e req-af66afac-0fc0-43d1-ba2d-fc48b16b593b tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 with Priority: HIGHEST for action security_group_members [ 1731.844083] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 with Priority: HIGHEST for action security_group_members [ 1731.844429] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-a690bc8f-598b-4a61-b995-8ba77d7e9291 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1731.844560] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1731.844625] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1731.844827] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1731.844980] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1731.845267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1731.845337] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1731.845514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1731.845608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1731.845704] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a690bc8f-598b-4a61-b995-8ba77d7e9291',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1732.347863] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1732.348107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1732.348107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1732.348319] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1732.348412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1732.348620] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1732.348716] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1732.348778] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1732.348928] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1732.349013] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1732.349114] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 is going to be updated. [ 1732.389281] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1732.389509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1732.389509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1732.389702] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1732.389846] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1732.403684] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 in Status: IN_PROGRESS for 2s [ 1734.414881] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 in Status: SUCCESS [ 1734.415321] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 deletion is rescheduled due to dependency. [ 1734.415321] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1736.509287] env[70535]: INFO networking_nsxv3.common.synchronization [None req-125646cf-8ed1-42aa-a5f5-061eb9da960b tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 with Priority: HIGHEST for action security_group_rules [ 1736.509616] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 with Priority: HIGHEST for action security_group_rules [ 1736.509925] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d21ade7-180a-43db-8fff-e069ee2ab331 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.510075] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1736.510143] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1736.510383] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1736.510467] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d21ade7-180a-43db-8fff-e069ee2ab331',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1736.579158] env[70535]: INFO networking_nsxv3.common.synchronization [None req-0ecf5668-f83b-43cc-a29f-514cd0d593cb tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 with Priority: HIGHEST for action security_group_rules [ 1736.579202] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 with Priority: HIGHEST for action security_group_rules [ 1736.579511] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d21ade7-180a-43db-8fff-e069ee2ab331 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1736.579610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.032173] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.032318] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.032398] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.032620] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.032711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.032811] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 already deleted. [ 1737.032895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.033052] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.033213] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.033294] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d21ade7-180a-43db-8fff-e069ee2ab331',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1737.553712] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1737.554154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1737.554154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1737.554339] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1737.554421] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1737.554570] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 already deleted. [ 1737.554688] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1741.580314] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1741.580624] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1741.883897] env[70535]: INFO networking_nsxv3.common.synchronization [req-69f7c163-5f99-4d6b-b338-9f7449412c94 req-0ab192c2-6119-48b8-90e2-d1b30494ca36 tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 with Priority: HIGHEST for action security_group_members [ 1741.884424] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 with Priority: HIGHEST for action security_group_members [ 1741.884799] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d21ade7-180a-43db-8fff-e069ee2ab331 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1741.884975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1741.885023] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1741.885392] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1741.885631] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1741.885728] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1741.885813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1741.885950] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1741.886042] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1741.886137] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d21ade7-180a-43db-8fff-e069ee2ab331',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1742.173581] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.173785] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1742.173913] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1742.174220] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1742.174560] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.174731] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1742.174854] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1742.175103] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1742.175258] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1742.175485] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1742.175601] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1742.175716] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1742.175857] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1742.175983] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1742.176128] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1742.176270] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1742.199055] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1742.199277] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1742.199382] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1742.199589] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1742.199920] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-4a187c35-d16f-426b-9ce3-3185d2770c15 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.200117] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-4a187c35-d16f-426b-9ce3-3185d2770c15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1742.200244] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-4a187c35-d16f-426b-9ce3-3185d2770c15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1742.200581] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-4a187c35-d16f-426b-9ce3-3185d2770c15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1742.200724] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a187c35-d16f-426b-9ce3-3185d2770c15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1742.388339] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.388531] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1742.388531] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1742.388721] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1742.388814] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1742.389023] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.389133] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1742.389257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1742.389421] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1742.389525] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1742.389576] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 already deleted. [ 1742.389649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1742.703149] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.703574] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1742.703574] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1742.703813] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1742.704013] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1742.704179] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 4a187c35-d16f-426b-9ce3-3185d2770c15 not found, creating... [ 1742.704457] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.704615] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1742.704739] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1742.704958] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1742.705128] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1742.705414] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.705570] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1742.705694] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1742.705901] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1742.706055] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1742.706200] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 4a187c35-d16f-426b-9ce3-3185d2770c15 is going to be created. [ 1742.725948] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1742.726176] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1742.726307] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1742.726606] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1742.726851] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1742.727100] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-4a187c35-d16f-426b-9ce3-3185d2770c15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.391623] env[70535]: INFO networking_nsxv3.common.synchronization [req-69f7c163-5f99-4d6b-b338-9f7449412c94 req-3e0912f9-2965-4bdc-b8ef-e17b781a842f service nova] Enqueued Resource ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 with Priority: HIGHEST for action security_group_rules [ 1743.391896] env[70535]: INFO networking_nsxv3.common.synchronization [req-69f7c163-5f99-4d6b-b338-9f7449412c94 req-3e0912f9-2965-4bdc-b8ef-e17b781a842f service nova] Enqueued Resource ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 with Priority: HIGHEST for action security_group_members [ 1743.392141] env[70535]: INFO networking_nsxv3.common.synchronization [req-69f7c163-5f99-4d6b-b338-9f7449412c94 req-3e0912f9-2965-4bdc-b8ef-e17b781a842f service nova] Enqueued Resource ID: 4a187c35-d16f-426b-9ce3-3185d2770c15 with Priority: HIGHEST for action port [ 1743.392385] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 with Priority: HIGHEST for action security_group_rules [ 1743.392549] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 with Priority: HIGHEST for action security_group_members [ 1743.392676] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a187c35-d16f-426b-9ce3-3185d2770c15 with Priority: HIGHEST for action port [ 1743.393332] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d21ade7-180a-43db-8fff-e069ee2ab331 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.393465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.393536] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.393738] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.393817] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d21ade7-180a-43db-8fff-e069ee2ab331',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1743.394645] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d21ade7-180a-43db-8fff-e069ee2ab331 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.394759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.394825] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.394990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.395185] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.395253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.395306] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.395430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.395515] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.395602] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d21ade7-180a-43db-8fff-e069ee2ab331',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1743.396337] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a187c35-d16f-426b-9ce3-3185d2770c15 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.396663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a187c35-d16f-426b-9ce3-3185d2770c15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.396663] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a187c35-d16f-426b-9ce3-3185d2770c15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.396727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a187c35-d16f-426b-9ce3-3185d2770c15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.396812] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a187c35-d16f-426b-9ce3-3185d2770c15',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1743.898255] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d21ade7-180a-43db-8fff-e069ee2ab331',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1743.899327] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d21ade7-180a-43db-8fff-e069ee2ab331 taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.899527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.899590] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a187c35-d16f-426b-9ce3-3185d2770c15 with status ACTIVE [ 1743.899756] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.899864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.899927] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.900171] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.900259] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.900431] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.900520] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.900581] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.900734] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.900799] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.900982] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.901137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.901206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.901359] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.901416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.901474] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a187c35-d16f-426b-9ce3-3185d2770c15 is going to be updated. [ 1743.921504] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1743.921694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1743.921694] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1743.921888] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1743.922038] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1743.922195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a187c35-d16f-426b-9ce3-3185d2770c15" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.404064] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d21ade7-180a-43db-8fff-e069ee2ab331',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1744.906786] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.907110] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.907110] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.907256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.907351] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.907450] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 is going to be created. [ 1744.931826] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.932052] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.932052] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.932270] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.932429] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1744.941886] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 in Status: UNINITIALIZED for 2s [ 1746.952802] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 in Status: SUCCESS [ 1746.953167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1746.953167] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1746.953372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1746.953565] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1746.953750] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1746.953831] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1746.954010] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1746.954102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1746.954189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1746.954319] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d21ade7-180a-43db-8fff-e069ee2ab331',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1747.456591] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d21ade7-180a-43db-8fff-e069ee2ab331',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1747.961052] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d21ade7-180a-43db-8fff-e069ee2ab331: rpc.has_security_group_logging(os_id): False [ 1747.977225] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.977408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1747.977452] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1747.977700] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1747.977790] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1747.978046] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1747.978152] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1747.978217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1747.978372] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1747.978476] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1747.978570] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 is going to be created. [ 1748.034487] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1748.034711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1748.034711] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1748.034998] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1748.035125] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1748.046797] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 in Status: IN_PROGRESS for 2s [ 1748.393816] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1748.393992] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1750.059666] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 in Status: SUCCESS [ 1750.060048] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1753.395470] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1753.395968] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1758.396386] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1758.396905] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1763.397534] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1763.397936] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1768.398599] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1768.398599] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1773.399479] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1773.399479] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1778.400351] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1778.400718] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1783.401435] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1783.401846] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1788.402743] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1788.403160] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1793.404236] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1793.404649] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1797.005637] env[70535]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] NSXv3 Agent Agent loop - iteration:4 completed [ 1797.005997] env[70535]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6df31357-6be7-4343-bc45-8668d4038ebc None None] NSXv3 Agent Agent loop - iteration:5 started [ 1798.404993] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1798.405411] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1803.406095] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1803.406553] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1804.627265] env[70535]: INFO networking_nsxv3.common.synchronization [req-1b45d306-86df-4a00-9edb-807e42804ca4 req-09ab61d0-9a0e-4e73-86f1-57acfa304ec0 tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 with Priority: HIGHEST for action security_group_members [ 1804.627914] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 with Priority: HIGHEST for action security_group_members [ 1804.630377] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d21ade7-180a-43db-8fff-e069ee2ab331 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1804.630557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1804.630655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1804.630899] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1804.631104] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1804.631257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1804.631347] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1804.631544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1804.631651] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1804.631764] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d21ade7-180a-43db-8fff-e069ee2ab331',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1805.133776] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.133975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.133975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1805.134223] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1805.134319] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1805.134515] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.134612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.134678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1805.134824] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1805.134948] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1805.135071] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 is going to be updated. [ 1805.173401] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1805.173640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1805.173640] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1805.173808] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1805.173946] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1805.182063] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 in Status: IN_PROGRESS for 2s [ 1807.192926] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 in Status: SUCCESS [ 1807.193346] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 deletion is rescheduled due to dependency. [ 1807.193346] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1809.314356] env[70535]: INFO networking_nsxv3.common.synchronization [None req-160ebe80-a875-43f4-9779-ae5091cd3065 tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d with Priority: HIGHEST for action security_group_rules [ 1809.314865] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d with Priority: HIGHEST for action security_group_rules [ 1809.315189] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1809.315526] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1809.315526] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1809.315789] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1809.315896] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5630864-1356-40f0-ab50-1fb1c1dc8f8d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1809.383340] env[70535]: INFO networking_nsxv3.common.synchronization [None req-f44197cc-810d-4f36-b0ce-ea2147660134 tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d with Priority: HIGHEST for action security_group_rules [ 1809.383891] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d with Priority: HIGHEST for action security_group_rules [ 1809.384191] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1809.384294] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1809.836678] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1809.836874] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1809.836922] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1809.837130] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1809.837224] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1809.837321] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d already deleted. [ 1809.837405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1809.837596] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1809.837762] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1809.837849] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5630864-1356-40f0-ab50-1fb1c1dc8f8d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1810.357556] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1810.357854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1810.357854] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1810.357993] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1810.358112] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1810.358172] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d already deleted. [ 1810.358253] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1814.384730] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1814.384730] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1814.877623] env[70535]: INFO networking_nsxv3.common.synchronization [req-f4504d29-0ab3-45c2-8ada-be63ab5b5ec5 req-f832c557-7238-4207-8e53-368dfdeee299 tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d with Priority: HIGHEST for action security_group_members [ 1814.878189] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d with Priority: HIGHEST for action security_group_members [ 1814.878553] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1814.878707] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1814.878788] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1814.879051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1814.879209] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1814.879334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1814.879442] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1814.879536] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1814.879672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1814.879801] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5630864-1356-40f0-ab50-1fb1c1dc8f8d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1815.169671] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1815.169874] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1815.170009] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1815.170290] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1815.170557] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1815.170724] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1815.170846] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1815.171199] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1815.171380] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1815.171662] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1815.171793] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] NeedRegenerationException {{(pid=70535) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1815.171911] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] no value, waiting for create lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1815.172030] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] value creation lock acquired {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1815.172147] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] No value present for key: 'zone-id' {{(pid=70535) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1815.172257] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Calling creation function for not-yet-present value {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1815.172396] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1815.194238] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1815.194427] env[70535]: DEBUG dogpile.cache.region [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70535) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1815.194633] env[70535]: DEBUG dogpile.lock [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Released creation lock {{(pid=70535) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1815.194889] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "network-820" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1815.195247] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock port-0f1ed975-cd4c-4b1f-a201-0e61509a6797 taken with stack trace [, , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1815.195429] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "port-0f1ed975-cd4c-4b1f-a201-0e61509a6797" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1815.195557] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "port-0f1ed975-cd4c-4b1f-a201-0e61509a6797" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1815.195893] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "port-0f1ed975-cd4c-4b1f-a201-0e61509a6797" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1815.196062] env[70535]: DEBUG networking_nsxv3.api.rpc [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f1ed975-cd4c-4b1f-a201-0e61509a6797',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1815.384266] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1815.384491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1815.384491] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1815.384704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1815.384796] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1815.385091] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1815.385168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1815.385168] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1815.385312] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1815.385387] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1815.385475] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d already deleted. [ 1815.385574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1815.698212] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1815.698448] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1815.698582] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1815.698956] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1815.699144] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1815.699313] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Segment Port 0f1ed975-cd4c-4b1f-a201-0e61509a6797 not found, creating... [ 1815.699580] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1815.699749] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1815.699872] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1815.700121] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1815.700269] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1815.700558] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1815.700722] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1815.700844] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1815.701075] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1815.701220] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1815.701367] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Resource: SegmentPort with ID: 0f1ed975-cd4c-4b1f-a201-0e61509a6797 is going to be created. [ 1815.722820] env[70535]: DEBUG networking_nsxv3.common.locking [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1815.722820] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1815.722820] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1815.722820] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1815.722820] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1815.722820] env[70535]: DEBUG oslo_concurrency.lockutils [None req-bb209054-1aa7-48f6-89cc-2c555c44e35b None None] Releasing lock "port-0f1ed975-cd4c-4b1f-a201-0e61509a6797" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1816.395439] env[70535]: INFO networking_nsxv3.common.synchronization [req-f4504d29-0ab3-45c2-8ada-be63ab5b5ec5 req-0db77f3d-64a8-4ddc-9dc2-bd75b1d30ca4 service nova] Enqueued Resource ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d with Priority: HIGHEST for action security_group_rules [ 1816.395749] env[70535]: INFO networking_nsxv3.common.synchronization [req-f4504d29-0ab3-45c2-8ada-be63ab5b5ec5 req-0db77f3d-64a8-4ddc-9dc2-bd75b1d30ca4 service nova] Enqueued Resource ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d with Priority: HIGHEST for action security_group_members [ 1816.395825] env[70535]: INFO networking_nsxv3.common.synchronization [req-f4504d29-0ab3-45c2-8ada-be63ab5b5ec5 req-0db77f3d-64a8-4ddc-9dc2-bd75b1d30ca4 service nova] Enqueued Resource ID: 0f1ed975-cd4c-4b1f-a201-0e61509a6797 with Priority: HIGHEST for action port [ 1816.396065] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d with Priority: HIGHEST for action security_group_rules [ 1816.396196] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d with Priority: HIGHEST for action security_group_members [ 1816.396294] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f1ed975-cd4c-4b1f-a201-0e61509a6797 with Priority: HIGHEST for action port [ 1816.396908] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1816.397037] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1816.397122] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1816.397329] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1816.397411] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5630864-1356-40f0-ab50-1fb1c1dc8f8d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1816.398297] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1816.398414] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1816.398523] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1816.398745] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1816.398949] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1816.399475] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1816.399567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1816.399777] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1816.399915] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1816.400070] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5630864-1356-40f0-ab50-1fb1c1dc8f8d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1816.400926] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f1ed975-cd4c-4b1f-a201-0e61509a6797 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1816.401085] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f1ed975-cd4c-4b1f-a201-0e61509a6797" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1816.401200] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f1ed975-cd4c-4b1f-a201-0e61509a6797" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1816.401403] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f1ed975-cd4c-4b1f-a201-0e61509a6797" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1816.401516] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f1ed975-cd4c-4b1f-a201-0e61509a6797',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1816.903238] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1816.903472] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1816.903548] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f1ed975-cd4c-4b1f-a201-0e61509a6797 with status ACTIVE [ 1816.903722] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1816.903850] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1816.903929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1816.904181] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1816.904276] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1816.904457] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1816.904557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1816.904621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1816.904769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1816.904861] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1816.905076] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1816.905182] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1816.905245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1816.905432] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1816.905460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1816.905540] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f1ed975-cd4c-4b1f-a201-0e61509a6797 is going to be updated. [ 1816.906660] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5630864-1356-40f0-ab50-1fb1c1dc8f8d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1816.929717] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1816.929983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1816.929983] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1816.930159] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1816.930302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1816.930504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f1ed975-cd4c-4b1f-a201-0e61509a6797" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1817.409392] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5630864-1356-40f0-ab50-1fb1c1dc8f8d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1817.911617] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1817.911837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1817.911837] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1817.912093] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1817.912189] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1817.912295] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d is going to be created. [ 1817.935740] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1817.935931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1817.935931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1817.936121] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1817.936279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1817.945316] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d in Status: UNINITIALIZED for 2s [ 1819.955663] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d in Status: SUCCESS [ 1819.956031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1819.956031] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1819.956228] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1819.956424] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1819.956547] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1819.956608] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1819.956760] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1819.956844] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1819.956931] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1819.957029] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5630864-1356-40f0-ab50-1fb1c1dc8f8d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1820.459496] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5630864-1356-40f0-ab50-1fb1c1dc8f8d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1820.961723] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5630864-1356-40f0-ab50-1fb1c1dc8f8d: rpc.has_security_group_logging(os_id): False [ 1820.983246] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1820.983459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1820.983459] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1820.983679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1820.983786] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1820.984032] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1820.984138] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1820.984201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1820.984353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1820.984430] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1820.984515] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d is going to be created. [ 1821.056252] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1821.056473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1821.056473] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1821.056668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1821.056849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1821.066664] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d in Status: IN_PROGRESS for 2s [ 1821.397632] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1821.397747] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1823.081446] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d in Status: SUCCESS [ 1823.081921] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1826.399060] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1826.399410] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1831.399916] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1831.400308] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1836.401307] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1836.401731] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1837.949636] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1837.950035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1837.950035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1837.950035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1837.950205] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1838.452747] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1838.955750] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1839.458612] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1839.458807] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1840.198562] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.198974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.198974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.198974] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.216186] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1840.217428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.218551] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1840.261029] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.261301] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.261363] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.261705] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.285836] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.286729] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1840.286829] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1840.286917] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1840.313984] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.314214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.314214] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.314418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.314780] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.314913] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1840.396329] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.396543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.396543] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.396785] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.397096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.397382] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1840.478202] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.478412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.478412] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.478622] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.479077] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.479277] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:6. [ 1840.479362] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'6d21ade7-180a-43db-8fff-e069ee2ab331', 'c5630864-1356-40f0-ab50-1fb1c1dc8f8d', 'a690bc8f-598b-4a61-b995-8ba77d7e9291', '7ea6f373-312d-4294-911b-5e12a2fbc3f4', 'cf801cfb-8004-42d6-a945-4d3f88953372', 'f32aa9cd-fe8f-4b69-8037-59fa1cf6570c'} {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1840.479432] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1840.498235] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.498411] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.498455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.498625] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.498710] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.498821] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1840.498888] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1840.498962] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1840.572579] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.572791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.572791] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.573029] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.574160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.574468] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1840.574545] env[70535]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70535) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1840.574593] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1840.574640] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1840.574683] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 6/6 resources of Type:Security Group Rules [ 1840.574755] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 with Priority: HIGH for action security_group_rules [ 1840.574832] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d with Priority: HIGH for action security_group_rules [ 1840.574900] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 with Priority: HIGH for action security_group_rules [ 1840.574965] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 with Priority: HIGH for action security_group_rules [ 1840.575042] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cf801cfb-8004-42d6-a945-4d3f88953372 with Priority: HIGH for action security_group_rules [ 1840.575108] env[70535]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGH for action security_group_rules [ 1840.575177] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1840.575239] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1840.575417] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.575513] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.575575] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.575729] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.575813] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.575997] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.576104] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.576156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.576296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.576367] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.576533] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.576627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.576687] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.576822] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.576895] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.577076] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.577177] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.577229] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.577356] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.577428] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.577592] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.577680] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.577739] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.577886] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.577968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.578151] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.578245] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.578305] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.578443] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.578517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.578683] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.578774] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.578834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.579011] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.579102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.579278] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.579401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.579458] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.579554] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.579627] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.579792] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.579881] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.579944] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.580096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.580176] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.580329] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.580418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.580477] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.580611] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.580682] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.580846] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.580935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.580995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.581142] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.581212] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.581375] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.581465] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.581523] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.581655] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.581727] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.581889] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.581981] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.582051] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.582185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.582256] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.582421] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.582509] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.582567] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.582701] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.582771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.582932] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.583035] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.583096] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.583230] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.583302] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.583463] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.583551] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.583610] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.583741] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.583812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.583975] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.584079] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.584134] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.584267] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.584336] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.584499] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.584617] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.584670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.584769] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.584840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.585010] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.585109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.585169] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.585303] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.585373] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.585535] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.585623] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.585678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.585812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.585883] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.586058] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.586147] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.586201] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.586337] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.586408] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.586570] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.586659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.586717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.586849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.586926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.587103] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.587209] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.587301] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.587454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.587528] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.587694] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.587783] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.587841] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.587995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.588081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.588247] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.588338] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.588396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.588529] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.588599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.588759] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.588847] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.588902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.589049] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.589127] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.589282] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.589371] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.589435] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.589562] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.589628] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.589790] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.589880] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.589940] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.590083] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.590155] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.590317] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.590405] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.590463] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.590597] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.590668] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.590828] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.590917] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.590976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.591123] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.591194] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.591354] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.591443] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.591501] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.591633] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.591704] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.591899] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.591996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.592067] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.592203] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.592275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.592438] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.592527] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.592586] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.592717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.592801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.592967] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.593069] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.593121] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.593257] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.593327] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.593489] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.593579] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.593636] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.593767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.593839] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.594008] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.594107] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.594165] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.594297] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.594368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.594530] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.594619] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.594717] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.594805] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.594875] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.595112] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.595217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.595279] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.595416] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.595487] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.595651] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.595742] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.595801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.595935] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.596014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.596185] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.596275] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.596334] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.596467] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.596538] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.596699] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.596812] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.596902] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.597065] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.597140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.597307] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.597396] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.597455] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.597589] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.597659] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.597824] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.597939] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.598019] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.598164] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.598237] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.598404] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.598493] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.598552] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.598684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.598755] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.598916] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.599040] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.599110] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.599251] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.599322] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.599486] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.599580] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.599630] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.599764] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.599834] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.599996] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.600099] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.600157] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.600293] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.600363] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.600523] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.600612] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.600670] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.600801] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.600872] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.601048] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.601140] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.601197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.601330] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.601401] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.601563] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.601650] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.601709] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.601838] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.601909] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.602085] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.602175] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.602233] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.602365] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.602436] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.602596] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.602684] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.602741] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.602871] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.602942] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.603119] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.603205] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.603263] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.603395] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.603466] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.603626] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.603713] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.603771] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.603900] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.603972] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.604146] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.604235] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.604289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.604437] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.604544] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.604722] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.604840] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.604897] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.605015] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.605087] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.605251] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.605342] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.605397] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.605529] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.605599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.605761] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.605849] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.605924] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.606082] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.606156] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.606322] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.606413] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.606471] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.606606] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.606677] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.606838] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.606929] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.606989] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.607137] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.607209] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.607373] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.607462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.607554] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.607649] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.607718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.607887] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.607995] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.608069] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.608206] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.608278] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.608443] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.608532] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.608588] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.608720] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.608792] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.608957] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.609078] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.609132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.609269] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.609340] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.609502] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.609591] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.609647] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.609780] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.609851] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.610046] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.610154] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.610218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.610378] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.610453] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.610618] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.610707] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.610763] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.610898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.610971] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.611252] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.611370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.611449] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.611599] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.611673] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.611842] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.611934] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.611996] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.612146] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.612218] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.612398] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.612534] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.612601] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.612744] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.612817] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.612987] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.613094] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.613153] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.613289] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.613360] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.613525] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.613615] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.613672] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.613803] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.613873] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.613987] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1840.614064] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1840.614135] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1840.683939] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.684186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.684186] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.684368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.684678] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.684952] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1840.761785] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.762014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1840.762014] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1840.762160] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1840.762462] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1840.776103] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1841.402212] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1841.402564] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=6], Jobs=0 [ 1841.402564] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 with Priority: HIGH for action security_group_rules [ 1841.402564] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 with Priority: HIGH for action security_group_rules [ 1841.402692] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c with Priority: HIGH for action security_group_rules [ 1841.402762] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf801cfb-8004-42d6-a945-4d3f88953372 with Priority: HIGH for action security_group_rules [ 1841.402856] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d with Priority: HIGH for action security_group_rules [ 1841.402975] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 with Priority: HIGH for action security_group_rules [ 1841.403396] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d21ade7-180a-43db-8fff-e069ee2ab331 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.403870] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.403870] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.403984] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.403984] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d21ade7-180a-43db-8fff-e069ee2ab331',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1841.404951] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a690bc8f-598b-4a61-b995-8ba77d7e9291 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.405540] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.405621] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.405797] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.405889] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a690bc8f-598b-4a61-b995-8ba77d7e9291',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1841.406715] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.406904] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.406904] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.407047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.407120] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f32aa9cd-fe8f-4b69-8037-59fa1cf6570c',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1841.407818] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf801cfb-8004-42d6-a945-4d3f88953372 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.407976] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.408081] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.408273] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.408350] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf801cfb-8004-42d6-a945-4d3f88953372',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1841.410920] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.411034] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.411109] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.411277] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.411334] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5630864-1356-40f0-ab50-1fb1c1dc8f8d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1841.412255] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4 taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.412407] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.412514] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.412681] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.412756] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea6f373-312d-4294-911b-5e12a2fbc3f4',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1841.915289] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.915454] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.915504] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.915688] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.915864] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.915990] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.916072] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.916226] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.916313] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1841.916399] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1841.916486] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5630864-1356-40f0-ab50-1fb1c1dc8f8d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1841.934313] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.934517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.934558] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.934775] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.947310] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.947490] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.948214] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.948314] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.949025] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.949195] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.950057] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1841.950157] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1841.952144] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1841.952253] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf801cfb-8004-42d6-a945-4d3f88953372 is going to be deleted. [ 1841.953092] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.953296] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.971011] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1841.971172] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a690bc8f-598b-4a61-b995-8ba77d7e9291 is going to be deleted. [ 1841.971975] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.972197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1841.991574] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1841.991734] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f32aa9cd-fe8f-4b69-8037-59fa1cf6570c is going to be deleted. [ 1841.992557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1841.992767] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.007172] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.007385] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.016370] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.016526] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d21ade7-180a-43db-8fff-e069ee2ab331 is going to be deleted. [ 1842.017353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.017563] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.029058] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.029217] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.034920] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.035056] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea6f373-312d-4294-911b-5e12a2fbc3f4 is going to be deleted. [ 1842.035898] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.036149] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.036247] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.036368] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf801cfb-8004-42d6-a945-4d3f88953372" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.036517] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.036679] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.036761] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.036868] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a690bc8f-598b-4a61-b995-8ba77d7e9291" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.052690] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.052878] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.052926] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.053132] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.053265] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.053404] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f32aa9cd-fe8f-4b69-8037-59fa1cf6570c" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.102568] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.102770] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.102770] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.102987] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.103101] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.103227] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d21ade7-180a-43db-8fff-e069ee2ab331" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.164795] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.165047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.165047] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.165274] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.165353] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.165475] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea6f373-312d-4294-911b-5e12a2fbc3f4" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.421565] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5630864-1356-40f0-ab50-1fb1c1dc8f8d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1842.924026] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5630864-1356-40f0-ab50-1fb1c1dc8f8d: rpc.has_security_group_logging(os_id): False [ 1842.943092] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.943361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.943361] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.943549] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.964232] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.964533] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.964652] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1842.964718] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1842.964913] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1842.964997] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1842.965126] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d is going to be updated. [ 1843.026805] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1843.027066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1843.027066] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1843.027266] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1843.027418] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1843.039887] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d in Status: IN_PROGRESS for 2s [ 1845.056646] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d in Status: SUCCESS [ 1845.057036] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1846.403595] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1846.404036] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1851.404432] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1851.404828] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1856.405350] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1856.405885] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1861.406034] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1861.406405] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1866.407578] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1866.407578] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1871.408690] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1871.409144] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1876.410169] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1876.410526] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1876.889736] env[70535]: INFO networking_nsxv3.common.synchronization [req-307d2de3-cd0b-4451-b108-9f1cbb3ec8d5 req-3e3c8f01-f1bd-4ba3-a9ff-2cd454f130a0 tempest-AttachVolumeNegativeTest-1665967681 tempest-AttachVolumeNegativeTest-1665967681-project-member] Enqueued Resource ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d with Priority: HIGHEST for action security_group_members [ 1876.890758] env[70535]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d with Priority: HIGHEST for action security_group_members [ 1876.891119] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d taken with stack trace [, , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.891325] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.891449] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1876.891759] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1876.892037] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.892211] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1876.892335] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1876.892582] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1876.892730] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1876.893100] env[70535]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5630864-1356-40f0-ab50-1fb1c1dc8f8d',) {} {{(pid=70535) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1877.395947] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.396197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1877.396197] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1877.396460] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1877.396557] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1877.396750] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.396876] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1877.396937] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1877.397102] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1877.397185] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1877.397274] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d is going to be updated. [ 1877.426309] env[70535]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70535) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.426712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1877.426712] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1877.426864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1877.426864] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1877.435123] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d in Status: IN_PROGRESS for 2s [ 1879.445577] env[70535]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d in Status: SUCCESS [ 1879.445968] env[70535]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5630864-1356-40f0-ab50-1fb1c1dc8f8d deletion is rescheduled due to dependency. [ 1879.445968] env[70535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5630864-1356-40f0-ab50-1fb1c1dc8f8d" {{(pid=70535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1881.891741] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1881.892156] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1886.893101] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1886.893466] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1891.893950] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1891.894295] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1896.895750] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1896.896254] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1901.897271] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1901.897635] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1906.898626] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1906.898626] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1911.899493] env[70535]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1911.899831] env[70535]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0